2023-03-06T13:38:30.023 INFO:root:teuthology version: 0.0.1.dev51+ga2dfb05 2023-03-06T13:38:30.024 DEBUG:teuthology.run:Teuthology command: teuthology --verbose --owner scheduled_vshankar@teuthology --archive /home/teuthworker/archive/vshankar-2023-03-06_13:28:53-fs-wip-vshankar-testing-20230303.023823-testing-default-smithi/7195189 --description fs/snaps/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/workunit/snaps} --name vshankar-2023-03-06_13:28:53-fs-wip-vshankar-testing-20230303.023823-testing-default-smithi -- /home/teuthworker/archive/vshankar-2023-03-06_13:28:53-fs-wip-vshankar-testing-20230303.023823-testing-default-smithi/7195189/orig.config.yaml 2023-03-06T13:38:30.066 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2023-03-06T13:38:30.144 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/vshankar-2023-03-06_13:28:53-fs-wip-vshankar-testing-20230303.023823-testing-default-smithi/7195189 branch: wip-vshankar-testing-20230303.023823 description: fs/snaps/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/workunit/snaps} email: vshankar@redhat.com first_in_suite: false job_id: '7195189' kernel: client: sha1: distro flavor: default kdb: true sha1: 75534f74ac3dd06f86697ff862e8be2945b3c8e6 last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: vshankar-2023-03-06_13:28:53-fs-wip-vshankar-testing-20230303.023823-testing-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: rhel os_version: '8.6' overrides: admin_socket: branch: wip-vshankar-testing-20230303.023823 ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding sha1: 472aaef4ec3b3a2c29f73ca67854785a910f1f9b ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 472aaef4ec3b3a2c29f73ca67854785a910f1f9b kclient: syntax: v2 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-vshankar-testing-20230303.023823 sha1: 472aaef4ec3b3a2c29f73ca67854785a910f1f9b owner: scheduled_vshankar@teuthology priority: 30 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 sha1: 472aaef4ec3b3a2c29f73ca67854785a910f1f9b sleep_before_teardown: 0 suite: fs suite_branch: wip-vshankar-testing-20230303.023823 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_472aaef4ec3b3a2c29f73ca67854785a910f1f9b/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 472aaef4ec3b3a2c29f73ca67854785a910f1f9b syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi086.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs= smithi202.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: null - kclient: null - workunit: clients: all: - fs/snaps timeout: 6h teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: a2dfb0599b24ec4a1585108a2792a4567ce0a378 timestamp: 2023-03-06_13:28:53 tube: smithi use_shaman: true user: vshankar verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.31660 2023-03-06T13:38:30.144 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_472aaef4ec3b3a2c29f73ca67854785a910f1f9b/qa; will attempt to use it 2023-03-06T13:38:30.145 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_472aaef4ec3b3a2c29f73ca67854785a910f1f9b/qa/tasks 2023-03-06T13:38:30.146 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-03-06T13:38:30.147 INFO:teuthology.task.internal:Checking packages... 2023-03-06T13:38:30.176 INFO:teuthology.task.internal:Checking packages for os_type 'rhel', flavor 'default' and ceph hash '472aaef4ec3b3a2c29f73ca67854785a910f1f9b' 2023-03-06T13:38:30.176 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-03-06T13:38:30.177 INFO:teuthology.packaging:ref: None 2023-03-06T13:38:30.177 INFO:teuthology.packaging:tag: None 2023-03-06T13:38:30.177 INFO:teuthology.packaging:branch: wip-vshankar-testing-20230303.023823 2023-03-06T13:38:30.178 INFO:teuthology.packaging:sha1: 472aaef4ec3b3a2c29f73ca67854785a910f1f9b 2023-03-06T13:38:30.178 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=wip-vshankar-testing-20230303.023823 2023-03-06T13:38:30.317 INFO:teuthology.task.internal:Found packages for ceph version 18.0.0-2739.g472aaef4 2023-03-06T13:38:30.318 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-03-06T13:38:30.324 INFO:teuthology.task.internal:no buildpackages task found 2023-03-06T13:38:30.325 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-03-06T13:38:30.346 INFO:teuthology.task.internal:Saving configuration 2023-03-06T13:38:30.364 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-03-06T13:38:30.370 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-03-06T13:38:30.400 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi086.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-03-06_13:28:53-fs-wip-vshankar-testing-20230303.023823-testing-default-smithi/7195189', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-03-06 13:30:17.990981', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-03-06T13:38:30.429 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi202.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-03-06_13:28:53-fs-wip-vshankar-testing-20230303.023823-testing-default-smithi/7195189', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-03-06 13:30:17.993303', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-03-06T13:38:30.430 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-03-06T13:38:30.436 INFO:teuthology.task.internal:roles: ubuntu@smithi086.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2023-03-06T13:38:30.436 INFO:teuthology.task.internal:roles: ubuntu@smithi202.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7'] 2023-03-06T13:38:30.437 INFO:teuthology.run_tasks:Running task console_log... 2023-03-06T13:38:30.526 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f28ef9724c0>, signals=[15]) 2023-03-06T13:38:30.527 INFO:teuthology.run_tasks:Running task internal.connect... 2023-03-06T13:38:30.534 INFO:teuthology.task.internal:Opening connections... 2023-03-06T13:38:30.534 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi086.front.sepia.ceph.com 2023-03-06T13:38:30.536 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-03-06T13:38:30.608 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi202.front.sepia.ceph.com 2023-03-06T13:38:30.609 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi202.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-03-06T13:38:30.676 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-03-06T13:38:30.683 DEBUG:teuthology.orchestra.run.smithi086:> uname -m 2023-03-06T13:38:30.703 INFO:teuthology.orchestra.run.smithi086.stdout:x86_64 2023-03-06T13:38:30.704 DEBUG:teuthology.orchestra.run.smithi086:> cat /etc/os-release 2023-03-06T13:38:30.766 INFO:teuthology.orchestra.run.smithi086.stdout:NAME="Red Hat Enterprise Linux" 2023-03-06T13:38:30.766 INFO:teuthology.orchestra.run.smithi086.stdout:VERSION="8.6 (Ootpa)" 2023-03-06T13:38:30.766 INFO:teuthology.orchestra.run.smithi086.stdout:ID="rhel" 2023-03-06T13:38:30.766 INFO:teuthology.orchestra.run.smithi086.stdout:ID_LIKE="fedora" 2023-03-06T13:38:30.766 INFO:teuthology.orchestra.run.smithi086.stdout:VERSION_ID="8.6" 2023-03-06T13:38:30.767 INFO:teuthology.orchestra.run.smithi086.stdout:PLATFORM_ID="platform:el8" 2023-03-06T13:38:30.767 INFO:teuthology.orchestra.run.smithi086.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-03-06T13:38:30.767 INFO:teuthology.orchestra.run.smithi086.stdout:ANSI_COLOR="0;31" 2023-03-06T13:38:30.767 INFO:teuthology.orchestra.run.smithi086.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-03-06T13:38:30.767 INFO:teuthology.orchestra.run.smithi086.stdout:HOME_URL="https://www.redhat.com/" 2023-03-06T13:38:30.767 INFO:teuthology.orchestra.run.smithi086.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-03-06T13:38:30.767 INFO:teuthology.orchestra.run.smithi086.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-03-06T13:38:30.768 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-03-06T13:38:30.768 INFO:teuthology.orchestra.run.smithi086.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-03-06T13:38:30.768 INFO:teuthology.orchestra.run.smithi086.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-03-06T13:38:30.768 INFO:teuthology.orchestra.run.smithi086.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-03-06T13:38:30.768 INFO:teuthology.orchestra.run.smithi086.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-03-06T13:38:30.769 INFO:teuthology.lock.ops:Updating smithi086.front.sepia.ceph.com on lock server 2023-03-06T13:38:30.794 DEBUG:teuthology.orchestra.run.smithi202:> uname -m 2023-03-06T13:38:30.813 INFO:teuthology.orchestra.run.smithi202.stdout:x86_64 2023-03-06T13:38:30.813 DEBUG:teuthology.orchestra.run.smithi202:> cat /etc/os-release 2023-03-06T13:38:30.871 INFO:teuthology.orchestra.run.smithi202.stdout:NAME="Red Hat Enterprise Linux" 2023-03-06T13:38:30.871 INFO:teuthology.orchestra.run.smithi202.stdout:VERSION="8.6 (Ootpa)" 2023-03-06T13:38:30.872 INFO:teuthology.orchestra.run.smithi202.stdout:ID="rhel" 2023-03-06T13:38:30.872 INFO:teuthology.orchestra.run.smithi202.stdout:ID_LIKE="fedora" 2023-03-06T13:38:30.872 INFO:teuthology.orchestra.run.smithi202.stdout:VERSION_ID="8.6" 2023-03-06T13:38:30.872 INFO:teuthology.orchestra.run.smithi202.stdout:PLATFORM_ID="platform:el8" 2023-03-06T13:38:30.872 INFO:teuthology.orchestra.run.smithi202.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-03-06T13:38:30.872 INFO:teuthology.orchestra.run.smithi202.stdout:ANSI_COLOR="0;31" 2023-03-06T13:38:30.872 INFO:teuthology.orchestra.run.smithi202.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-03-06T13:38:30.873 INFO:teuthology.orchestra.run.smithi202.stdout:HOME_URL="https://www.redhat.com/" 2023-03-06T13:38:30.873 INFO:teuthology.orchestra.run.smithi202.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-03-06T13:38:30.873 INFO:teuthology.orchestra.run.smithi202.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-03-06T13:38:30.873 INFO:teuthology.orchestra.run.smithi202.stdout: 2023-03-06T13:38:30.873 INFO:teuthology.orchestra.run.smithi202.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-03-06T13:38:30.873 INFO:teuthology.orchestra.run.smithi202.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-03-06T13:38:30.873 INFO:teuthology.orchestra.run.smithi202.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-03-06T13:38:30.874 INFO:teuthology.orchestra.run.smithi202.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-03-06T13:38:30.874 INFO:teuthology.lock.ops:Updating smithi202.front.sepia.ceph.com on lock server 2023-03-06T13:38:30.902 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-03-06T13:38:30.911 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-03-06T13:38:30.918 INFO:teuthology.task.internal:Checking for old test directory... 2023-03-06T13:38:30.918 DEBUG:teuthology.orchestra.run.smithi086:> test '!' -e /home/ubuntu/cephtest 2023-03-06T13:38:30.921 DEBUG:teuthology.orchestra.run.smithi202:> test '!' -e /home/ubuntu/cephtest 2023-03-06T13:38:30.939 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-03-06T13:38:30.945 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-03-06T13:38:30.946 DEBUG:teuthology.orchestra.run.smithi086:> test -z $(ls -A /var/lib/ceph) 2023-03-06T13:38:30.983 DEBUG:teuthology.orchestra.run.smithi202:> test -z $(ls -A /var/lib/ceph) 2023-03-06T13:38:31.005 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-03-06T13:38:31.062 INFO:teuthology.run_tasks:Running task kernel... 2023-03-06T13:38:31.077 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'flavor': 'default', 'kdb': True, 'sha1': '75534f74ac3dd06f86697ff862e8be2945b3c8e6'} 2023-03-06T13:38:31.077 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}} 2023-03-06T13:38:31.078 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}}, timeout 300 2023-03-06T13:38:31.078 DEBUG:teuthology.orchestra.run.smithi086:> test -f /run/.containerenv -o -f /.dockerenv 2023-03-06T13:38:31.096 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-03-06T13:38:31.096 DEBUG:teuthology.orchestra.run.smithi086:> uname -r 2023-03-06T13:38:31.158 INFO:teuthology.orchestra.run.smithi086.stdout:4.18.0-372.9.1.el8.x86_64 2023-03-06T13:38:31.159 INFO:teuthology.task.kernel:Running kernel on smithi086: 4.18.0-372.9.1.el8.x86_64 2023-03-06T13:38:31.159 DEBUG:teuthology.orchestra.run.smithi086:> sudo yum install -y kernel 2023-03-06T13:38:32.325 INFO:teuthology.orchestra.run.smithi086.stdout:Updating Subscription Management repositories. 2023-03-06T13:38:32.325 INFO:teuthology.orchestra.run.smithi086.stdout:Unable to read consumer identity 2023-03-06T13:38:33.852 INFO:teuthology.orchestra.run.smithi086.stdout:Copr repo for python3-asyncssh owned by ceph 16 kB/s | 3.5 kB 00:00 2023-03-06T13:38:36.494 INFO:teuthology.orchestra.run.smithi086.stdout:Extra Packages for Enterprise Linux 5.2 MB/s | 14 MB 00:02 2023-03-06T13:38:39.844 INFO:teuthology.orchestra.run.smithi086.stdout:lab-extras 74 kB/s | 24 kB 00:00 2023-03-06T13:38:40.513 INFO:teuthology.orchestra.run.smithi086.stdout:Package kernel-4.18.0-372.9.1.el8.x86_64 is already installed. 2023-03-06T13:38:40.566 INFO:teuthology.orchestra.run.smithi086.stdout:Dependencies resolved. 2023-03-06T13:38:40.566 INFO:teuthology.orchestra.run.smithi086.stdout:Nothing to do. 2023-03-06T13:38:40.567 INFO:teuthology.orchestra.run.smithi086.stdout:Complete! 2023-03-06T13:38:40.711 DEBUG:teuthology.orchestra.run.smithi086:> echo no | sudo yum reinstall kernel || true 2023-03-06T13:38:41.040 INFO:teuthology.orchestra.run.smithi086.stdout:Updating Subscription Management repositories. 2023-03-06T13:38:41.041 INFO:teuthology.orchestra.run.smithi086.stdout:Unable to read consumer identity 2023-03-06T13:38:41.293 INFO:teuthology.orchestra.run.smithi086.stdout:Last metadata expiration check: 0:00:02 ago on Mon 06 Mar 2023 01:38:39 PM UTC. 2023-03-06T13:38:41.334 INFO:teuthology.orchestra.run.smithi086.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-03-06T13:38:41.366 INFO:teuthology.orchestra.run.smithi086.stderr:Error: No packages marked for reinstall. 2023-03-06T13:38:41.412 DEBUG:teuthology.orchestra.run.smithi086:> sudo yum reinstall -y kernel || true 2023-03-06T13:38:41.742 INFO:teuthology.orchestra.run.smithi086.stdout:Updating Subscription Management repositories. 2023-03-06T13:38:41.743 INFO:teuthology.orchestra.run.smithi086.stdout:Unable to read consumer identity 2023-03-06T13:38:41.990 INFO:teuthology.orchestra.run.smithi086.stdout:Last metadata expiration check: 0:00:02 ago on Mon 06 Mar 2023 01:38:39 PM UTC. 2023-03-06T13:38:42.030 INFO:teuthology.orchestra.run.smithi086.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-03-06T13:38:42.065 INFO:teuthology.orchestra.run.smithi086.stderr:Error: No packages marked for reinstall. 2023-03-06T13:38:42.115 DEBUG:teuthology.orchestra.run.smithi086:> rpm -q kernel --last | head -n 1 2023-03-06T13:38:42.194 INFO:teuthology.orchestra.run.smithi086.stdout:kernel-4.18.0-372.9.1.el8.x86_64 Thu 14 Jul 2022 06:23:21 PM UTC 2023-03-06T13:38:42.196 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-372.9.1.el8.x86_64 2023-03-06T13:38:42.196 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2023-03-06T13:38:42.196 DEBUG:teuthology.parallel:result is None 2023-03-06T13:38:42.197 INFO:teuthology.run_tasks:Running task internal.base... 2023-03-06T13:38:42.203 INFO:teuthology.task.internal:Creating test directory... 2023-03-06T13:38:42.204 DEBUG:teuthology.orchestra.run.smithi086:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-03-06T13:38:42.206 DEBUG:teuthology.orchestra.run.smithi202:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-03-06T13:38:42.227 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-03-06T13:38:42.234 INFO:teuthology.run_tasks:Running task internal.archive... 2023-03-06T13:38:42.243 INFO:teuthology.task.internal:Creating archive directory... 2023-03-06T13:38:42.244 DEBUG:teuthology.orchestra.run.smithi086:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-03-06T13:38:42.262 DEBUG:teuthology.orchestra.run.smithi202:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-03-06T13:38:42.296 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-03-06T13:38:42.304 INFO:teuthology.task.internal:Enabling coredump saving... 2023-03-06T13:38:42.304 DEBUG:teuthology.orchestra.run.smithi202:> test -f /run/.containerenv -o -f /.dockerenv 2023-03-06T13:38:42.352 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-03-06T13:38:42.352 DEBUG:teuthology.orchestra.run.smithi086:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-03-06T13:38:42.354 DEBUG:teuthology.orchestra.run.smithi202:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-03-06T13:38:42.387 INFO:teuthology.orchestra.run.smithi086.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-03-06T13:38:42.398 INFO:teuthology.orchestra.run.smithi086.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-03-06T13:38:42.445 INFO:teuthology.orchestra.run.smithi202.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-03-06T13:38:42.460 INFO:teuthology.orchestra.run.smithi202.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-03-06T13:38:42.462 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-03-06T13:38:42.469 INFO:teuthology.task.internal:Configuring sudo... 2023-03-06T13:38:42.469 DEBUG:teuthology.orchestra.run.smithi086:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-03-06T13:38:42.471 DEBUG:teuthology.orchestra.run.smithi202:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-03-06T13:38:42.500 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-03-06T13:38:42.508 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-03-06T13:38:42.508 DEBUG:teuthology.orchestra.run.smithi086:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-03-06T13:38:42.537 DEBUG:teuthology.orchestra.run.smithi202:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-03-06T13:38:42.558 DEBUG:teuthology.orchestra.run.smithi086:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-03-06T13:38:42.639 DEBUG:teuthology.orchestra.run.smithi086:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-03-06T13:38:42.680 DEBUG:teuthology.orchestra.run.smithi086:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-03-06T13:38:42.767 DEBUG:teuthology.orchestra.run.smithi086:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-03-06T13:38:42.804 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2023-03-06T13:38:42.804 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-03-06T13:38:42.875 DEBUG:teuthology.orchestra.run.smithi202:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-03-06T13:38:42.925 DEBUG:teuthology.orchestra.run.smithi202:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-03-06T13:38:42.974 DEBUG:teuthology.orchestra.run.smithi202:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-03-06T13:38:43.062 DEBUG:teuthology.orchestra.run.smithi202:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-03-06T13:38:43.102 DEBUG:teuthology.orchestra.run.smithi202:> set -ex 2023-03-06T13:38:43.102 DEBUG:teuthology.orchestra.run.smithi202:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-03-06T13:38:43.170 DEBUG:teuthology.orchestra.run.smithi086:> sudo service rsyslog restart 2023-03-06T13:38:43.172 DEBUG:teuthology.orchestra.run.smithi202:> sudo service rsyslog restart 2023-03-06T13:38:43.222 INFO:teuthology.orchestra.run.smithi086.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-03-06T13:38:43.282 INFO:teuthology.orchestra.run.smithi202.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-03-06T13:38:43.665 INFO:teuthology.run_tasks:Running task internal.timer... 2023-03-06T13:38:43.674 INFO:teuthology.task.internal:Starting timer... 2023-03-06T13:38:43.674 INFO:teuthology.run_tasks:Running task pcp... 2023-03-06T13:38:43.736 INFO:teuthology.run_tasks:Running task selinux... 2023-03-06T13:38:43.744 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2023-03-06T13:38:43.745 DEBUG:teuthology.orchestra.run.smithi086:> sudo service auditd rotate 2023-03-06T13:38:43.802 INFO:teuthology.orchestra.run.smithi086.stdout:Rotating logs: 2023-03-06T13:38:43.803 DEBUG:teuthology.orchestra.run.smithi202:> sudo service auditd rotate 2023-03-06T13:38:43.862 INFO:teuthology.orchestra.run.smithi202.stdout:Rotating logs: 2023-03-06T13:38:43.863 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-03-06T13:38:43.864 DEBUG:teuthology.orchestra.run.smithi086:> /usr/sbin/getenforce 2023-03-06T13:38:43.901 INFO:teuthology.orchestra.run.smithi086.stdout:Permissive 2023-03-06T13:38:43.901 DEBUG:teuthology.orchestra.run.smithi202:> /usr/sbin/getenforce 2023-03-06T13:38:43.920 INFO:teuthology.orchestra.run.smithi202.stdout:Permissive 2023-03-06T13:38:43.921 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi086.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi202.front.sepia.ceph.com': 'permissive'} 2023-03-06T13:38:43.921 DEBUG:teuthology.orchestra.run.smithi086:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-03-06T13:38:43.968 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-03-06T13:38:43.968 DEBUG:teuthology.orchestra.run.smithi202:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-03-06T13:38:43.998 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-03-06T13:38:43.999 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-03-06T13:38:43.999 DEBUG:teuthology.orchestra.run.smithi086:> sudo /usr/sbin/setenforce permissive 2023-03-06T13:38:44.035 DEBUG:teuthology.orchestra.run.smithi202:> sudo /usr/sbin/setenforce permissive 2023-03-06T13:38:44.065 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-03-06T13:38:44.074 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2023-03-06T13:38:44.081 INFO:teuthology.repo_utils:Fetching main from origin 2023-03-06T13:38:44.209 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-03-06T13:38:44.228 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-03-06T13:38:44.229 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi086.front.sepia.ceph.com,smithi202.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-03-06T13:45:57.811 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi086.front.sepia.ceph.com'), Remote(name='ubuntu@smithi202.front.sepia.ceph.com')] 2023-03-06T13:45:57.812 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi086.front.sepia.ceph.com' 2023-03-06T13:45:57.813 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-03-06T13:45:57.882 DEBUG:teuthology.orchestra.run.smithi086:> true 2023-03-06T13:45:57.908 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi202.front.sepia.ceph.com' 2023-03-06T13:45:57.909 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi202.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-03-06T13:45:57.978 DEBUG:teuthology.orchestra.run.smithi202:> true 2023-03-06T13:45:58.048 INFO:teuthology.run_tasks:Running task clock... 2023-03-06T13:45:58.061 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-03-06T13:45:58.061 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-03-06T13:45:58.062 DEBUG:teuthology.orchestra.run.smithi086:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-03-06T13:45:58.064 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-03-06T13:45:58.065 DEBUG:teuthology.orchestra.run.smithi202:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-03-06T13:45:58.094 INFO:teuthology.orchestra.run.smithi086.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-03-06T13:45:58.109 INFO:teuthology.orchestra.run.smithi086.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-03-06T13:45:58.121 INFO:teuthology.orchestra.run.smithi202.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-03-06T13:45:58.137 INFO:teuthology.orchestra.run.smithi202.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-03-06T13:45:58.189 INFO:teuthology.orchestra.run.smithi086.stderr:sudo: ntpd: command not found 2023-03-06T13:45:58.199 INFO:teuthology.orchestra.run.smithi202.stderr:sudo: ntpd: command not found 2023-03-06T13:45:58.201 INFO:teuthology.orchestra.run.smithi086.stdout:506 Cannot talk to daemon 2023-03-06T13:45:58.211 INFO:teuthology.orchestra.run.smithi202.stdout:506 Cannot talk to daemon 2023-03-06T13:45:58.216 INFO:teuthology.orchestra.run.smithi086.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-03-06T13:45:58.226 INFO:teuthology.orchestra.run.smithi202.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-03-06T13:45:58.229 INFO:teuthology.orchestra.run.smithi086.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-03-06T13:45:58.241 INFO:teuthology.orchestra.run.smithi202.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-03-06T13:45:58.310 INFO:teuthology.orchestra.run.smithi086.stderr:bash: ntpq: command not found 2023-03-06T13:45:58.314 INFO:teuthology.orchestra.run.smithi202.stderr:bash: ntpq: command not found 2023-03-06T13:45:58.314 INFO:teuthology.orchestra.run.smithi086.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-03-06T13:45:58.315 INFO:teuthology.orchestra.run.smithi086.stdout:=============================================================================== 2023-03-06T13:45:58.315 INFO:teuthology.orchestra.run.smithi086.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-03-06T13:45:58.315 INFO:teuthology.orchestra.run.smithi086.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-03-06T13:45:58.315 INFO:teuthology.orchestra.run.smithi086.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-03-06T13:45:58.315 INFO:teuthology.orchestra.run.smithi086.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-03-06T13:45:58.317 INFO:teuthology.orchestra.run.smithi202.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-03-06T13:45:58.317 INFO:teuthology.orchestra.run.smithi202.stdout:=============================================================================== 2023-03-06T13:45:58.318 INFO:teuthology.orchestra.run.smithi202.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-03-06T13:45:58.318 INFO:teuthology.orchestra.run.smithi202.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-03-06T13:45:58.318 INFO:teuthology.orchestra.run.smithi202.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-03-06T13:45:58.318 INFO:teuthology.orchestra.run.smithi202.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-03-06T13:45:58.319 INFO:teuthology.run_tasks:Running task install... 2023-03-06T13:45:58.329 DEBUG:teuthology.task.install:project ceph 2023-03-06T13:45:58.330 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '472aaef4ec3b3a2c29f73ca67854785a910f1f9b'}} 2023-03-06T13:45:58.330 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '472aaef4ec3b3a2c29f73ca67854785a910f1f9b'} 2023-03-06T13:45:58.330 INFO:teuthology.task.install:Using flavor: default 2023-03-06T13:45:58.336 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-03-06T13:45:58.336 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-03-06T13:45:58.337 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '472aaef4ec3b3a2c29f73ca67854785a910f1f9b', 'tag': None, 'wait_for_package': False} 2023-03-06T13:45:58.338 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=472aaef4ec3b3a2c29f73ca67854785a910f1f9b 2023-03-06T13:45:58.340 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '472aaef4ec3b3a2c29f73ca67854785a910f1f9b', 'tag': None, 'wait_for_package': False} 2023-03-06T13:45:58.340 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=472aaef4ec3b3a2c29f73ca67854785a910f1f9b 2023-03-06T13:45:58.482 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230303.023823/472aaef4ec3b3a2c29f73ca67854785a910f1f9b/centos/8/flavors/default/ 2023-03-06T13:45:58.483 INFO:teuthology.task.install.rpm:Package version is 18.0.0-2739.g472aaef4 2023-03-06T13:45:58.515 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230303.023823/472aaef4ec3b3a2c29f73ca67854785a910f1f9b/centos/8/flavors/default/ 2023-03-06T13:45:58.515 INFO:teuthology.task.install.rpm:Package version is 18.0.0-2739.g472aaef4 2023-03-06T13:45:58.586 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230303.023823/472aaef4ec3b3a2c29f73ca67854785a910f1f9b/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230303.023823/472aaef4ec3b3a2c29f73ca67854785a910f1f9b/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230303.023823/472aaef4ec3b3a2c29f73ca67854785a910f1f9b/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-03-06T13:45:58.586 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2023-03-06T13:45:58.586 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-03-06T13:45:58.613 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-03-06T13:45:58.614 DEBUG:teuthology.orchestra.run.smithi086:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/472aaef4ec3b3a2c29f73ca67854785a910f1f9b/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-03-06T13:45:58.617 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230303.023823/472aaef4ec3b3a2c29f73ca67854785a910f1f9b/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230303.023823/472aaef4ec3b3a2c29f73ca67854785a910f1f9b/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230303.023823/472aaef4ec3b3a2c29f73ca67854785a910f1f9b/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-03-06T13:45:58.617 DEBUG:teuthology.orchestra.run.smithi202:> set -ex 2023-03-06T13:45:58.617 DEBUG:teuthology.orchestra.run.smithi202:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-03-06T13:45:58.646 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-03-06T13:45:58.646 DEBUG:teuthology.orchestra.run.smithi202:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/472aaef4ec3b3a2c29f73ca67854785a910f1f9b/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-03-06T13:45:58.680 DEBUG:teuthology.orchestra.run.smithi086:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-03-06T13:45:58.714 DEBUG:teuthology.orchestra.run.smithi202:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-03-06T13:45:58.757 DEBUG:teuthology.orchestra.run.smithi086:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-03-06T13:45:58.791 DEBUG:teuthology.orchestra.run.smithi202:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-03-06T13:45:58.823 INFO:teuthology.orchestra.run.smithi086.stdout:check_obsoletes = 1 2023-03-06T13:45:58.824 DEBUG:teuthology.orchestra.run.smithi086:> sudo yum clean all 2023-03-06T13:45:58.859 INFO:teuthology.orchestra.run.smithi202.stdout:check_obsoletes = 1 2023-03-06T13:45:58.860 DEBUG:teuthology.orchestra.run.smithi202:> sudo yum clean all 2023-03-06T13:45:59.194 INFO:teuthology.orchestra.run.smithi086.stdout:Updating Subscription Management repositories. 2023-03-06T13:45:59.230 INFO:teuthology.orchestra.run.smithi202.stdout:Updating Subscription Management repositories. 2023-03-06T13:45:59.443 INFO:teuthology.orchestra.run.smithi086.stdout:44 files removed 2023-03-06T13:45:59.476 INFO:teuthology.orchestra.run.smithi202.stdout:44 files removed 2023-03-06T13:45:59.489 DEBUG:teuthology.orchestra.run.smithi086:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-03-06T13:45:59.524 DEBUG:teuthology.orchestra.run.smithi202:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-03-06T13:45:59.820 INFO:teuthology.orchestra.run.smithi086.stdout:Updating Subscription Management repositories. 2023-03-06T13:45:59.855 INFO:teuthology.orchestra.run.smithi202.stdout:Updating Subscription Management repositories. 2023-03-06T13:46:00.556 INFO:teuthology.orchestra.run.smithi202.stdout:ceph packages for x86_64 319 kB/s | 80 kB 00:00 2023-03-06T13:46:00.600 INFO:teuthology.orchestra.run.smithi086.stdout:ceph packages for x86_64 313 kB/s | 80 kB 00:00 2023-03-06T13:46:00.815 INFO:teuthology.orchestra.run.smithi202.stdout:ceph noarch packages 41 kB/s | 9.4 kB 00:00 2023-03-06T13:46:00.868 INFO:teuthology.orchestra.run.smithi086.stdout:ceph noarch packages 40 kB/s | 9.4 kB 00:00 2023-03-06T13:46:01.058 INFO:teuthology.orchestra.run.smithi202.stdout:ceph source packages 6.7 kB/s | 1.5 kB 00:00 2023-03-06T13:46:01.118 INFO:teuthology.orchestra.run.smithi086.stdout:ceph source packages 6.5 kB/s | 1.5 kB 00:00 2023-03-06T13:46:01.242 INFO:teuthology.orchestra.run.smithi202.stdout:Copr repo for python3-asyncssh owned by ceph 21 kB/s | 3.5 kB 00:00 2023-03-06T13:46:01.293 INFO:teuthology.orchestra.run.smithi086.stdout:Copr repo for python3-asyncssh owned by ceph 22 kB/s | 3.5 kB 00:00 2023-03-06T13:46:02.627 INFO:teuthology.orchestra.run.smithi086.stdout:Extra Packages for Enterprise Linux 10 MB/s | 14 MB 00:01 2023-03-06T13:46:02.734 INFO:teuthology.orchestra.run.smithi202.stdout:Extra Packages for Enterprise Linux 9.3 MB/s | 14 MB 00:01 2023-03-06T13:46:05.826 INFO:teuthology.orchestra.run.smithi202.stdout:lab-extras 385 kB/s | 24 kB 00:00 2023-03-06T13:46:05.836 INFO:teuthology.orchestra.run.smithi086.stdout:lab-extras 107 kB/s | 24 kB 00:00 2023-03-06T13:46:06.687 INFO:teuthology.orchestra.run.smithi202.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 60 MB/s | 47 MB 00:00 2023-03-06T13:46:06.696 INFO:teuthology.orchestra.run.smithi086.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 60 MB/s | 47 MB 00:00 2023-03-06T13:46:14.480 INFO:teuthology.orchestra.run.smithi086.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 68 MB/s | 53 MB 00:00 2023-03-06T13:46:14.570 INFO:teuthology.orchestra.run.smithi202.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 62 MB/s | 53 MB 00:00 2023-03-06T13:46:25.514 INFO:teuthology.orchestra.run.smithi086.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-03-06T13:46:25.515 INFO:teuthology.orchestra.run.smithi086.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-03-06T13:46:25.529 INFO:teuthology.orchestra.run.smithi086.stdout:Package NetworkManager-1:1.36.0-4.el8.x86_64 is already installed. 2023-03-06T13:46:25.530 INFO:teuthology.orchestra.run.smithi086.stdout:Package iproute-5.15.0-4.el8.x86_64 is already installed. 2023-03-06T13:46:25.531 INFO:teuthology.orchestra.run.smithi086.stdout:Package util-linux-2.32.1-35.el8.x86_64 is already installed. 2023-03-06T13:46:25.533 INFO:teuthology.orchestra.run.smithi086.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-03-06T13:46:25.535 INFO:teuthology.orchestra.run.smithi086.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-03-06T13:46:25.538 INFO:teuthology.orchestra.run.smithi086.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-03-06T13:46:25.539 INFO:teuthology.orchestra.run.smithi086.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-03-06T13:46:25.565 INFO:teuthology.orchestra.run.smithi202.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-03-06T13:46:25.566 INFO:teuthology.orchestra.run.smithi202.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-03-06T13:46:25.585 INFO:teuthology.orchestra.run.smithi202.stdout:Package NetworkManager-1:1.36.0-4.el8.x86_64 is already installed. 2023-03-06T13:46:25.586 INFO:teuthology.orchestra.run.smithi202.stdout:Package iproute-5.15.0-4.el8.x86_64 is already installed. 2023-03-06T13:46:25.586 INFO:teuthology.orchestra.run.smithi202.stdout:Package util-linux-2.32.1-35.el8.x86_64 is already installed. 2023-03-06T13:46:25.586 INFO:teuthology.orchestra.run.smithi202.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-03-06T13:46:25.587 INFO:teuthology.orchestra.run.smithi202.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-03-06T13:46:25.590 INFO:teuthology.orchestra.run.smithi202.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-03-06T13:46:25.592 INFO:teuthology.orchestra.run.smithi202.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-03-06T13:46:25.673 INFO:teuthology.orchestra.run.smithi086.stdout:Dependencies resolved. 2023-03-06T13:46:25.686 INFO:teuthology.orchestra.run.smithi086.stdout:=========================================================================================================================== 2023-03-06T13:46:25.686 INFO:teuthology.orchestra.run.smithi086.stdout: Package Arch Version Repository Size 2023-03-06T13:46:25.686 INFO:teuthology.orchestra.run.smithi086.stdout:=========================================================================================================================== 2023-03-06T13:46:25.687 INFO:teuthology.orchestra.run.smithi086.stdout:Installing: 2023-03-06T13:46:25.687 INFO:teuthology.orchestra.run.smithi086.stdout: NetworkManager-initscripts-updown noarch 1:1.36.0-9.el8_6 rhel-8-for-x86_64-baseos-rpms 138 k 2023-03-06T13:46:25.687 INFO:teuthology.orchestra.run.smithi086.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-03-06T13:46:25.687 INFO:teuthology.orchestra.run.smithi086.stdout: ceph x86_64 2:18.0.0-2739.g472aaef4.el8 ceph 6.4 k 2023-03-06T13:46:25.687 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-base x86_64 2:18.0.0-2739.g472aaef4.el8 ceph 5.4 M 2023-03-06T13:46:25.687 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-fuse x86_64 2:18.0.0-2739.g472aaef4.el8 ceph 845 k 2023-03-06T13:46:25.687 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-2739.g472aaef4.el8 ceph 166 k 2023-03-06T13:46:25.688 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-mgr x86_64 2:18.0.0-2739.g472aaef4.el8 ceph 1.5 M 2023-03-06T13:46:25.688 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-mgr-cephadm noarch 2:18.0.0-2739.g472aaef4.el8 ceph-noarch 123 k 2023-03-06T13:46:25.688 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-mgr-dashboard noarch 2:18.0.0-2739.g472aaef4.el8 ceph-noarch 1.7 M 2023-03-06T13:46:25.688 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-2739.g472aaef4.el8 ceph-noarch 7.4 M 2023-03-06T13:46:25.688 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-mgr-rook noarch 2:18.0.0-2739.g472aaef4.el8 ceph-noarch 47 k 2023-03-06T13:46:25.688 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-radosgw x86_64 2:18.0.0-2739.g472aaef4.el8 ceph 13 M 2023-03-06T13:46:25.688 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-test x86_64 2:18.0.0-2739.g472aaef4.el8 ceph 47 M 2023-03-06T13:46:25.688 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-volume noarch 2:18.0.0-2739.g472aaef4.el8 ceph-noarch 263 k 2023-03-06T13:46:25.689 INFO:teuthology.orchestra.run.smithi086.stdout: cephadm noarch 2:18.0.0-2739.g472aaef4.el8 ceph-noarch 83 k 2023-03-06T13:46:25.689 INFO:teuthology.orchestra.run.smithi086.stdout: cephfs-mirror x86_64 2:18.0.0-2739.g472aaef4.el8 ceph 257 k 2023-03-06T13:46:25.689 INFO:teuthology.orchestra.run.smithi086.stdout: cephfs-top noarch 2:18.0.0-2739.g472aaef4.el8 ceph-noarch 18 k 2023-03-06T13:46:25.689 INFO:teuthology.orchestra.run.smithi086.stdout: elfutils-libelf-devel x86_64 0.186-1.el8 rhel-8-for-x86_64-baseos-rpms 60 k 2023-03-06T13:46:25.689 INFO:teuthology.orchestra.run.smithi086.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-03-06T13:46:25.689 INFO:teuthology.orchestra.run.smithi086.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-03-06T13:46:25.689 INFO:teuthology.orchestra.run.smithi086.stdout: libcephfs-devel x86_64 2:18.0.0-2739.g472aaef4.el8 ceph 30 k 2023-03-06T13:46:25.690 INFO:teuthology.orchestra.run.smithi086.stdout: libcephfs2 x86_64 2:18.0.0-2739.g472aaef4.el8 ceph 767 k 2023-03-06T13:46:25.690 INFO:teuthology.orchestra.run.smithi086.stdout: librados-devel x86_64 2:18.0.0-2739.g472aaef4.el8 ceph 139 k 2023-03-06T13:46:25.690 INFO:teuthology.orchestra.run.smithi086.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-03-06T13:46:25.690 INFO:teuthology.orchestra.run.smithi086.stdout: libuuid-devel x86_64 2.32.1-35.el8 rhel-8-for-x86_64-baseos-rpms 98 k 2023-03-06T13:46:25.690 INFO:teuthology.orchestra.run.smithi086.stdout: openssl-devel x86_64 1:1.1.1k-7.el8_6 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-03-06T13:46:25.690 INFO:teuthology.orchestra.run.smithi086.stdout: postgresql x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 1.5 M 2023-03-06T13:46:25.690 INFO:teuthology.orchestra.run.smithi086.stdout: postgresql-contrib x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 808 k 2023-03-06T13:46:25.691 INFO:teuthology.orchestra.run.smithi086.stdout: postgresql-server x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 5.1 M 2023-03-06T13:46:25.691 INFO:teuthology.orchestra.run.smithi086.stdout: python3-cephfs x86_64 2:18.0.0-2739.g472aaef4.el8 ceph 190 k 2023-03-06T13:46:25.691 INFO:teuthology.orchestra.run.smithi086.stdout: python3-rados x86_64 2:18.0.0-2739.g472aaef4.el8 ceph 371 k 2023-03-06T13:46:25.691 INFO:teuthology.orchestra.run.smithi086.stdout: python3-rbd x86_64 2:18.0.0-2739.g472aaef4.el8 ceph 364 k 2023-03-06T13:46:25.693 INFO:teuthology.orchestra.run.smithi086.stdout: python3-rgw x86_64 2:18.0.0-2739.g472aaef4.el8 ceph 107 k 2023-03-06T13:46:25.693 INFO:teuthology.orchestra.run.smithi086.stdout: rbd-fuse x86_64 2:18.0.0-2739.g472aaef4.el8 ceph 94 k 2023-03-06T13:46:25.694 INFO:teuthology.orchestra.run.smithi086.stdout: rbd-mirror x86_64 2:18.0.0-2739.g472aaef4.el8 ceph 3.4 M 2023-03-06T13:46:25.694 INFO:teuthology.orchestra.run.smithi086.stdout: rbd-nbd x86_64 2:18.0.0-2739.g472aaef4.el8 ceph 180 k 2023-03-06T13:46:25.695 INFO:teuthology.orchestra.run.smithi086.stdout: xfsprogs-devel x86_64 5.0.0-10.el8 rhel-8-for-x86_64-baseos-rpms 72 k 2023-03-06T13:46:25.695 INFO:teuthology.orchestra.run.smithi086.stdout:Upgrading: 2023-03-06T13:46:25.695 INFO:teuthology.orchestra.run.smithi086.stdout: iproute x86_64 5.15.0-4.el8_6.1 rhel-8-for-x86_64-baseos-rpms 798 k 2023-03-06T13:46:25.695 INFO:teuthology.orchestra.run.smithi086.stdout: librados2 x86_64 2:18.0.0-2739.g472aaef4.el8 ceph 3.7 M 2023-03-06T13:46:25.695 INFO:teuthology.orchestra.run.smithi086.stdout: librbd1 x86_64 2:18.0.0-2739.g472aaef4.el8 ceph 3.6 M 2023-03-06T13:46:25.695 INFO:teuthology.orchestra.run.smithi086.stdout:Installing dependencies: 2023-03-06T13:46:25.695 INFO:teuthology.orchestra.run.smithi086.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-03-06T13:46:25.696 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-common x86_64 2:18.0.0-2739.g472aaef4.el8 ceph 22 M 2023-03-06T13:46:25.696 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-grafana-dashboards noarch 2:18.0.0-2739.g472aaef4.el8 ceph-noarch 23 k 2023-03-06T13:46:25.696 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-mds x86_64 2:18.0.0-2739.g472aaef4.el8 ceph 2.3 M 2023-03-06T13:46:25.696 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-mgr-modules-core noarch 2:18.0.0-2739.g472aaef4.el8 ceph-noarch 236 k 2023-03-06T13:46:25.696 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-mon x86_64 2:18.0.0-2739.g472aaef4.el8 ceph 4.6 M 2023-03-06T13:46:25.696 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-osd x86_64 2:18.0.0-2739.g472aaef4.el8 ceph 18 M 2023-03-06T13:46:25.696 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-prometheus-alerts noarch 2:18.0.0-2739.g472aaef4.el8 ceph-noarch 15 k 2023-03-06T13:46:25.697 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-selinux x86_64 2:18.0.0-2739.g472aaef4.el8 ceph 24 k 2023-03-06T13:46:25.697 INFO:teuthology.orchestra.run.smithi086.stdout: fuse x86_64 2.9.7-15.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-03-06T13:46:25.697 INFO:teuthology.orchestra.run.smithi086.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-03-06T13:46:25.697 INFO:teuthology.orchestra.run.smithi086.stdout: jq x86_64 1.6-3.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2023-03-06T13:46:25.697 INFO:teuthology.orchestra.run.smithi086.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-03-06T13:46:25.697 INFO:teuthology.orchestra.run.smithi086.stdout: krb5-devel x86_64 1.18.2-14.el8 rhel-8-for-x86_64-baseos-rpms 560 k 2023-03-06T13:46:25.697 INFO:teuthology.orchestra.run.smithi086.stdout: libcephsqlite x86_64 2:18.0.0-2739.g472aaef4.el8 ceph 137 k 2023-03-06T13:46:25.698 INFO:teuthology.orchestra.run.smithi086.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2023-03-06T13:46:25.698 INFO:teuthology.orchestra.run.smithi086.stdout: libgfortran x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 644 k 2023-03-06T13:46:25.698 INFO:teuthology.orchestra.run.smithi086.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-03-06T13:46:25.698 INFO:teuthology.orchestra.run.smithi086.stdout: libpq x86_64 13.5-1.el8 rhel-8-for-x86_64-appstream-rpms 198 k 2023-03-06T13:46:25.698 INFO:teuthology.orchestra.run.smithi086.stdout: libquadmath x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 171 k 2023-03-06T13:46:25.698 INFO:teuthology.orchestra.run.smithi086.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-03-06T13:46:25.698 INFO:teuthology.orchestra.run.smithi086.stdout: libradosstriper1 x86_64 2:18.0.0-2739.g472aaef4.el8 ceph 474 k 2023-03-06T13:46:25.699 INFO:teuthology.orchestra.run.smithi086.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2023-03-06T13:46:25.699 INFO:teuthology.orchestra.run.smithi086.stdout: librgw2 x86_64 2:18.0.0-2739.g472aaef4.el8 ceph 6.5 M 2023-03-06T13:46:25.699 INFO:teuthology.orchestra.run.smithi086.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-03-06T13:46:25.699 INFO:teuthology.orchestra.run.smithi086.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2023-03-06T13:46:25.699 INFO:teuthology.orchestra.run.smithi086.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-03-06T13:46:25.699 INFO:teuthology.orchestra.run.smithi086.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-03-06T13:46:25.699 INFO:teuthology.orchestra.run.smithi086.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-03-06T13:46:25.700 INFO:teuthology.orchestra.run.smithi086.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-03-06T13:46:25.700 INFO:teuthology.orchestra.run.smithi086.stdout: openblas x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-03-06T13:46:25.700 INFO:teuthology.orchestra.run.smithi086.stdout: openblas-threads x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.9 M 2023-03-06T13:46:25.700 INFO:teuthology.orchestra.run.smithi086.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-03-06T13:46:25.700 INFO:teuthology.orchestra.run.smithi086.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-03-06T13:46:25.700 INFO:teuthology.orchestra.run.smithi086.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-03-06T13:46:25.700 INFO:teuthology.orchestra.run.smithi086.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-03-06T13:46:25.701 INFO:teuthology.orchestra.run.smithi086.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-03-06T13:46:25.701 INFO:teuthology.orchestra.run.smithi086.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-03-06T13:46:25.701 INFO:teuthology.orchestra.run.smithi086.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-03-06T13:46:25.701 INFO:teuthology.orchestra.run.smithi086.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-03-06T13:46:25.701 INFO:teuthology.orchestra.run.smithi086.stdout: python3-ceph-argparse x86_64 2:18.0.0-2739.g472aaef4.el8 ceph 45 k 2023-03-06T13:46:25.706 INFO:teuthology.orchestra.run.smithi086.stdout: python3-ceph-common x86_64 2:18.0.0-2739.g472aaef4.el8 ceph 117 k 2023-03-06T13:46:25.706 INFO:teuthology.orchestra.run.smithi086.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-03-06T13:46:25.706 INFO:teuthology.orchestra.run.smithi086.stdout: python3-cffi x86_64 1.11.5-5.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2023-03-06T13:46:25.707 INFO:teuthology.orchestra.run.smithi086.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-03-06T13:46:25.707 INFO:teuthology.orchestra.run.smithi086.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-03-06T13:46:25.707 INFO:teuthology.orchestra.run.smithi086.stdout: python3-cryptography x86_64 3.2.1-5.el8 rhel-8-for-x86_64-baseos-rpms 559 k 2023-03-06T13:46:25.707 INFO:teuthology.orchestra.run.smithi086.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-03-06T13:46:25.707 INFO:teuthology.orchestra.run.smithi086.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-03-06T13:46:25.707 INFO:teuthology.orchestra.run.smithi086.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-03-06T13:46:25.707 INFO:teuthology.orchestra.run.smithi086.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2023-03-06T13:46:25.708 INFO:teuthology.orchestra.run.smithi086.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-03-06T13:46:25.708 INFO:teuthology.orchestra.run.smithi086.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-03-06T13:46:25.708 INFO:teuthology.orchestra.run.smithi086.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-03-06T13:46:25.708 INFO:teuthology.orchestra.run.smithi086.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-03-06T13:46:25.708 INFO:teuthology.orchestra.run.smithi086.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-03-06T13:46:25.708 INFO:teuthology.orchestra.run.smithi086.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-03-06T13:46:25.708 INFO:teuthology.orchestra.run.smithi086.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-03-06T13:46:25.709 INFO:teuthology.orchestra.run.smithi086.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-03-06T13:46:25.709 INFO:teuthology.orchestra.run.smithi086.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-03-06T13:46:25.709 INFO:teuthology.orchestra.run.smithi086.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-03-06T13:46:25.709 INFO:teuthology.orchestra.run.smithi086.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-03-06T13:46:25.709 INFO:teuthology.orchestra.run.smithi086.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-03-06T13:46:25.709 INFO:teuthology.orchestra.run.smithi086.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-03-06T13:46:25.709 INFO:teuthology.orchestra.run.smithi086.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-03-06T13:46:25.710 INFO:teuthology.orchestra.run.smithi086.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-03-06T13:46:25.710 INFO:teuthology.orchestra.run.smithi086.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2023-03-06T13:46:25.710 INFO:teuthology.orchestra.run.smithi086.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-03-06T13:46:25.710 INFO:teuthology.orchestra.run.smithi086.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-03-06T13:46:25.710 INFO:teuthology.orchestra.run.smithi086.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2023-03-06T13:46:25.710 INFO:teuthology.orchestra.run.smithi086.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-03-06T13:46:25.710 INFO:teuthology.orchestra.run.smithi086.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-03-06T13:46:25.711 INFO:teuthology.orchestra.run.smithi086.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-03-06T13:46:25.711 INFO:teuthology.orchestra.run.smithi086.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-03-06T13:46:25.711 INFO:teuthology.orchestra.run.smithi086.stdout: python3-rsa noarch 4.8-1.el8 epel 61 k 2023-03-06T13:46:25.711 INFO:teuthology.orchestra.run.smithi086.stdout: python3-scipy x86_64 1.0.0-21.module+el8.5.0+10916+41bd434d rhel-8-for-x86_64-appstream-rpms 14 M 2023-03-06T13:46:25.711 INFO:teuthology.orchestra.run.smithi086.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-03-06T13:46:25.711 INFO:teuthology.orchestra.run.smithi086.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-03-06T13:46:25.711 INFO:teuthology.orchestra.run.smithi086.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-03-06T13:46:25.711 INFO:teuthology.orchestra.run.smithi086.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-03-06T13:46:25.712 INFO:teuthology.orchestra.run.smithi086.stdout: python3-waitress noarch 1.2.1-2.el8.1 epel 241 k 2023-03-06T13:46:25.712 INFO:teuthology.orchestra.run.smithi086.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-03-06T13:46:25.712 INFO:teuthology.orchestra.run.smithi086.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-03-06T13:46:25.712 INFO:teuthology.orchestra.run.smithi086.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-03-06T13:46:25.712 INFO:teuthology.orchestra.run.smithi086.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-03-06T13:46:25.712 INFO:teuthology.orchestra.run.smithi086.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-03-06T13:46:25.712 INFO:teuthology.orchestra.run.smithi086.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2023-03-06T13:46:25.713 INFO:teuthology.orchestra.run.smithi086.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-03-06T13:46:25.713 INFO:teuthology.orchestra.run.smithi086.stdout: uuid x86_64 1.6.2-43.el8 rhel-8-for-x86_64-appstream-rpms 64 k 2023-03-06T13:46:25.713 INFO:teuthology.orchestra.run.smithi086.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-03-06T13:46:25.713 INFO:teuthology.orchestra.run.smithi086.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2023-03-06T13:46:25.713 INFO:teuthology.orchestra.run.smithi086.stdout:Enabling module streams: 2023-03-06T13:46:25.714 INFO:teuthology.orchestra.run.smithi086.stdout: postgresql 10 2023-03-06T13:46:25.714 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-03-06T13:46:25.715 INFO:teuthology.orchestra.run.smithi086.stdout:Transaction Summary 2023-03-06T13:46:25.715 INFO:teuthology.orchestra.run.smithi086.stdout:=========================================================================================================================== 2023-03-06T13:46:25.715 INFO:teuthology.orchestra.run.smithi086.stdout:Install 128 Packages 2023-03-06T13:46:25.716 INFO:teuthology.orchestra.run.smithi086.stdout:Upgrade 3 Packages 2023-03-06T13:46:25.716 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-03-06T13:46:25.717 INFO:teuthology.orchestra.run.smithi086.stdout:Total download size: 203 M 2023-03-06T13:46:25.717 INFO:teuthology.orchestra.run.smithi086.stdout:Downloading Packages: 2023-03-06T13:46:25.725 INFO:teuthology.orchestra.run.smithi202.stdout:Dependencies resolved. 2023-03-06T13:46:25.737 INFO:teuthology.orchestra.run.smithi202.stdout:=========================================================================================================================== 2023-03-06T13:46:25.737 INFO:teuthology.orchestra.run.smithi202.stdout: Package Arch Version Repository Size 2023-03-06T13:46:25.738 INFO:teuthology.orchestra.run.smithi202.stdout:=========================================================================================================================== 2023-03-06T13:46:25.738 INFO:teuthology.orchestra.run.smithi202.stdout:Installing: 2023-03-06T13:46:25.738 INFO:teuthology.orchestra.run.smithi202.stdout: NetworkManager-initscripts-updown noarch 1:1.36.0-9.el8_6 rhel-8-for-x86_64-baseos-rpms 138 k 2023-03-06T13:46:25.738 INFO:teuthology.orchestra.run.smithi202.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-03-06T13:46:25.738 INFO:teuthology.orchestra.run.smithi202.stdout: ceph x86_64 2:18.0.0-2739.g472aaef4.el8 ceph 6.4 k 2023-03-06T13:46:25.738 INFO:teuthology.orchestra.run.smithi202.stdout: ceph-base x86_64 2:18.0.0-2739.g472aaef4.el8 ceph 5.4 M 2023-03-06T13:46:25.739 INFO:teuthology.orchestra.run.smithi202.stdout: ceph-fuse x86_64 2:18.0.0-2739.g472aaef4.el8 ceph 845 k 2023-03-06T13:46:25.739 INFO:teuthology.orchestra.run.smithi202.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-2739.g472aaef4.el8 ceph 166 k 2023-03-06T13:46:25.739 INFO:teuthology.orchestra.run.smithi202.stdout: ceph-mgr x86_64 2:18.0.0-2739.g472aaef4.el8 ceph 1.5 M 2023-03-06T13:46:25.739 INFO:teuthology.orchestra.run.smithi202.stdout: ceph-mgr-cephadm noarch 2:18.0.0-2739.g472aaef4.el8 ceph-noarch 123 k 2023-03-06T13:46:25.739 INFO:teuthology.orchestra.run.smithi202.stdout: ceph-mgr-dashboard noarch 2:18.0.0-2739.g472aaef4.el8 ceph-noarch 1.7 M 2023-03-06T13:46:25.739 INFO:teuthology.orchestra.run.smithi202.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-2739.g472aaef4.el8 ceph-noarch 7.4 M 2023-03-06T13:46:25.739 INFO:teuthology.orchestra.run.smithi202.stdout: ceph-mgr-rook noarch 2:18.0.0-2739.g472aaef4.el8 ceph-noarch 47 k 2023-03-06T13:46:25.739 INFO:teuthology.orchestra.run.smithi202.stdout: ceph-radosgw x86_64 2:18.0.0-2739.g472aaef4.el8 ceph 13 M 2023-03-06T13:46:25.740 INFO:teuthology.orchestra.run.smithi202.stdout: ceph-test x86_64 2:18.0.0-2739.g472aaef4.el8 ceph 47 M 2023-03-06T13:46:25.740 INFO:teuthology.orchestra.run.smithi202.stdout: ceph-volume noarch 2:18.0.0-2739.g472aaef4.el8 ceph-noarch 263 k 2023-03-06T13:46:25.740 INFO:teuthology.orchestra.run.smithi202.stdout: cephadm noarch 2:18.0.0-2739.g472aaef4.el8 ceph-noarch 83 k 2023-03-06T13:46:25.740 INFO:teuthology.orchestra.run.smithi202.stdout: cephfs-mirror x86_64 2:18.0.0-2739.g472aaef4.el8 ceph 257 k 2023-03-06T13:46:25.740 INFO:teuthology.orchestra.run.smithi202.stdout: cephfs-top noarch 2:18.0.0-2739.g472aaef4.el8 ceph-noarch 18 k 2023-03-06T13:46:25.740 INFO:teuthology.orchestra.run.smithi202.stdout: elfutils-libelf-devel x86_64 0.186-1.el8 rhel-8-for-x86_64-baseos-rpms 60 k 2023-03-06T13:46:25.740 INFO:teuthology.orchestra.run.smithi202.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-03-06T13:46:25.741 INFO:teuthology.orchestra.run.smithi202.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-03-06T13:46:25.741 INFO:teuthology.orchestra.run.smithi202.stdout: libcephfs-devel x86_64 2:18.0.0-2739.g472aaef4.el8 ceph 30 k 2023-03-06T13:46:25.741 INFO:teuthology.orchestra.run.smithi202.stdout: libcephfs2 x86_64 2:18.0.0-2739.g472aaef4.el8 ceph 767 k 2023-03-06T13:46:25.741 INFO:teuthology.orchestra.run.smithi202.stdout: librados-devel x86_64 2:18.0.0-2739.g472aaef4.el8 ceph 139 k 2023-03-06T13:46:25.741 INFO:teuthology.orchestra.run.smithi202.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-03-06T13:46:25.741 INFO:teuthology.orchestra.run.smithi202.stdout: libuuid-devel x86_64 2.32.1-35.el8 rhel-8-for-x86_64-baseos-rpms 98 k 2023-03-06T13:46:25.741 INFO:teuthology.orchestra.run.smithi202.stdout: openssl-devel x86_64 1:1.1.1k-7.el8_6 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-03-06T13:46:25.742 INFO:teuthology.orchestra.run.smithi202.stdout: postgresql x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 1.5 M 2023-03-06T13:46:25.742 INFO:teuthology.orchestra.run.smithi202.stdout: postgresql-contrib x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 808 k 2023-03-06T13:46:25.742 INFO:teuthology.orchestra.run.smithi202.stdout: postgresql-server x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 5.1 M 2023-03-06T13:46:25.742 INFO:teuthology.orchestra.run.smithi202.stdout: python3-cephfs x86_64 2:18.0.0-2739.g472aaef4.el8 ceph 190 k 2023-03-06T13:46:25.742 INFO:teuthology.orchestra.run.smithi202.stdout: python3-rados x86_64 2:18.0.0-2739.g472aaef4.el8 ceph 371 k 2023-03-06T13:46:25.742 INFO:teuthology.orchestra.run.smithi202.stdout: python3-rbd x86_64 2:18.0.0-2739.g472aaef4.el8 ceph 364 k 2023-03-06T13:46:25.742 INFO:teuthology.orchestra.run.smithi202.stdout: python3-rgw x86_64 2:18.0.0-2739.g472aaef4.el8 ceph 107 k 2023-03-06T13:46:25.742 INFO:teuthology.orchestra.run.smithi202.stdout: rbd-fuse x86_64 2:18.0.0-2739.g472aaef4.el8 ceph 94 k 2023-03-06T13:46:25.743 INFO:teuthology.orchestra.run.smithi202.stdout: rbd-mirror x86_64 2:18.0.0-2739.g472aaef4.el8 ceph 3.4 M 2023-03-06T13:46:25.743 INFO:teuthology.orchestra.run.smithi202.stdout: rbd-nbd x86_64 2:18.0.0-2739.g472aaef4.el8 ceph 180 k 2023-03-06T13:46:25.743 INFO:teuthology.orchestra.run.smithi202.stdout: xfsprogs-devel x86_64 5.0.0-10.el8 rhel-8-for-x86_64-baseos-rpms 72 k 2023-03-06T13:46:25.743 INFO:teuthology.orchestra.run.smithi202.stdout:Upgrading: 2023-03-06T13:46:25.743 INFO:teuthology.orchestra.run.smithi202.stdout: iproute x86_64 5.15.0-4.el8_6.1 rhel-8-for-x86_64-baseos-rpms 798 k 2023-03-06T13:46:25.743 INFO:teuthology.orchestra.run.smithi202.stdout: librados2 x86_64 2:18.0.0-2739.g472aaef4.el8 ceph 3.7 M 2023-03-06T13:46:25.744 INFO:teuthology.orchestra.run.smithi202.stdout: librbd1 x86_64 2:18.0.0-2739.g472aaef4.el8 ceph 3.6 M 2023-03-06T13:46:25.744 INFO:teuthology.orchestra.run.smithi202.stdout:Installing dependencies: 2023-03-06T13:46:25.744 INFO:teuthology.orchestra.run.smithi202.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-03-06T13:46:25.744 INFO:teuthology.orchestra.run.smithi202.stdout: ceph-common x86_64 2:18.0.0-2739.g472aaef4.el8 ceph 22 M 2023-03-06T13:46:25.744 INFO:teuthology.orchestra.run.smithi202.stdout: ceph-grafana-dashboards noarch 2:18.0.0-2739.g472aaef4.el8 ceph-noarch 23 k 2023-03-06T13:46:25.745 INFO:teuthology.orchestra.run.smithi202.stdout: ceph-mds x86_64 2:18.0.0-2739.g472aaef4.el8 ceph 2.3 M 2023-03-06T13:46:25.745 INFO:teuthology.orchestra.run.smithi202.stdout: ceph-mgr-modules-core noarch 2:18.0.0-2739.g472aaef4.el8 ceph-noarch 236 k 2023-03-06T13:46:25.745 INFO:teuthology.orchestra.run.smithi202.stdout: ceph-mon x86_64 2:18.0.0-2739.g472aaef4.el8 ceph 4.6 M 2023-03-06T13:46:25.745 INFO:teuthology.orchestra.run.smithi202.stdout: ceph-osd x86_64 2:18.0.0-2739.g472aaef4.el8 ceph 18 M 2023-03-06T13:46:25.745 INFO:teuthology.orchestra.run.smithi202.stdout: ceph-prometheus-alerts noarch 2:18.0.0-2739.g472aaef4.el8 ceph-noarch 15 k 2023-03-06T13:46:25.745 INFO:teuthology.orchestra.run.smithi202.stdout: ceph-selinux x86_64 2:18.0.0-2739.g472aaef4.el8 ceph 24 k 2023-03-06T13:46:25.746 INFO:teuthology.orchestra.run.smithi202.stdout: fuse x86_64 2.9.7-15.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-03-06T13:46:25.746 INFO:teuthology.orchestra.run.smithi202.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-03-06T13:46:25.746 INFO:teuthology.orchestra.run.smithi202.stdout: jq x86_64 1.6-3.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2023-03-06T13:46:25.746 INFO:teuthology.orchestra.run.smithi202.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-03-06T13:46:25.746 INFO:teuthology.orchestra.run.smithi202.stdout: krb5-devel x86_64 1.18.2-14.el8 rhel-8-for-x86_64-baseos-rpms 560 k 2023-03-06T13:46:25.746 INFO:teuthology.orchestra.run.smithi202.stdout: libcephsqlite x86_64 2:18.0.0-2739.g472aaef4.el8 ceph 137 k 2023-03-06T13:46:25.746 INFO:teuthology.orchestra.run.smithi202.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2023-03-06T13:46:25.747 INFO:teuthology.orchestra.run.smithi202.stdout: libgfortran x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 644 k 2023-03-06T13:46:25.747 INFO:teuthology.orchestra.run.smithi202.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-03-06T13:46:25.747 INFO:teuthology.orchestra.run.smithi202.stdout: libpq x86_64 13.5-1.el8 rhel-8-for-x86_64-appstream-rpms 198 k 2023-03-06T13:46:25.747 INFO:teuthology.orchestra.run.smithi202.stdout: libquadmath x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 171 k 2023-03-06T13:46:25.747 INFO:teuthology.orchestra.run.smithi202.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-03-06T13:46:25.747 INFO:teuthology.orchestra.run.smithi202.stdout: libradosstriper1 x86_64 2:18.0.0-2739.g472aaef4.el8 ceph 474 k 2023-03-06T13:46:25.747 INFO:teuthology.orchestra.run.smithi202.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2023-03-06T13:46:25.747 INFO:teuthology.orchestra.run.smithi202.stdout: librgw2 x86_64 2:18.0.0-2739.g472aaef4.el8 ceph 6.5 M 2023-03-06T13:46:25.748 INFO:teuthology.orchestra.run.smithi202.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-03-06T13:46:25.748 INFO:teuthology.orchestra.run.smithi202.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2023-03-06T13:46:25.748 INFO:teuthology.orchestra.run.smithi202.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-03-06T13:46:25.748 INFO:teuthology.orchestra.run.smithi202.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-03-06T13:46:25.748 INFO:teuthology.orchestra.run.smithi202.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-03-06T13:46:25.748 INFO:teuthology.orchestra.run.smithi202.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-03-06T13:46:25.748 INFO:teuthology.orchestra.run.smithi202.stdout: openblas x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-03-06T13:46:25.749 INFO:teuthology.orchestra.run.smithi202.stdout: openblas-threads x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.9 M 2023-03-06T13:46:25.749 INFO:teuthology.orchestra.run.smithi202.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-03-06T13:46:25.749 INFO:teuthology.orchestra.run.smithi202.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-03-06T13:46:25.749 INFO:teuthology.orchestra.run.smithi202.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-03-06T13:46:25.749 INFO:teuthology.orchestra.run.smithi202.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-03-06T13:46:25.749 INFO:teuthology.orchestra.run.smithi202.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-03-06T13:46:25.749 INFO:teuthology.orchestra.run.smithi202.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-03-06T13:46:25.750 INFO:teuthology.orchestra.run.smithi202.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-03-06T13:46:25.750 INFO:teuthology.orchestra.run.smithi202.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-03-06T13:46:25.750 INFO:teuthology.orchestra.run.smithi202.stdout: python3-ceph-argparse x86_64 2:18.0.0-2739.g472aaef4.el8 ceph 45 k 2023-03-06T13:46:25.750 INFO:teuthology.orchestra.run.smithi202.stdout: python3-ceph-common x86_64 2:18.0.0-2739.g472aaef4.el8 ceph 117 k 2023-03-06T13:46:25.750 INFO:teuthology.orchestra.run.smithi202.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-03-06T13:46:25.750 INFO:teuthology.orchestra.run.smithi202.stdout: python3-cffi x86_64 1.11.5-5.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2023-03-06T13:46:25.750 INFO:teuthology.orchestra.run.smithi202.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-03-06T13:46:25.751 INFO:teuthology.orchestra.run.smithi202.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-03-06T13:46:25.751 INFO:teuthology.orchestra.run.smithi202.stdout: python3-cryptography x86_64 3.2.1-5.el8 rhel-8-for-x86_64-baseos-rpms 559 k 2023-03-06T13:46:25.751 INFO:teuthology.orchestra.run.smithi202.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-03-06T13:46:25.751 INFO:teuthology.orchestra.run.smithi202.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-03-06T13:46:25.751 INFO:teuthology.orchestra.run.smithi202.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-03-06T13:46:25.751 INFO:teuthology.orchestra.run.smithi202.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2023-03-06T13:46:25.751 INFO:teuthology.orchestra.run.smithi202.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-03-06T13:46:25.751 INFO:teuthology.orchestra.run.smithi202.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-03-06T13:46:25.752 INFO:teuthology.orchestra.run.smithi202.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-03-06T13:46:25.752 INFO:teuthology.orchestra.run.smithi202.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-03-06T13:46:25.752 INFO:teuthology.orchestra.run.smithi202.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-03-06T13:46:25.752 INFO:teuthology.orchestra.run.smithi202.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-03-06T13:46:25.752 INFO:teuthology.orchestra.run.smithi202.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-03-06T13:46:25.752 INFO:teuthology.orchestra.run.smithi202.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-03-06T13:46:25.752 INFO:teuthology.orchestra.run.smithi202.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-03-06T13:46:25.752 INFO:teuthology.orchestra.run.smithi202.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-03-06T13:46:25.753 INFO:teuthology.orchestra.run.smithi202.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-03-06T13:46:25.753 INFO:teuthology.orchestra.run.smithi202.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-03-06T13:46:25.753 INFO:teuthology.orchestra.run.smithi202.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-03-06T13:46:25.753 INFO:teuthology.orchestra.run.smithi202.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-03-06T13:46:25.753 INFO:teuthology.orchestra.run.smithi202.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-03-06T13:46:25.753 INFO:teuthology.orchestra.run.smithi202.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2023-03-06T13:46:25.753 INFO:teuthology.orchestra.run.smithi202.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-03-06T13:46:25.754 INFO:teuthology.orchestra.run.smithi202.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-03-06T13:46:25.754 INFO:teuthology.orchestra.run.smithi202.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2023-03-06T13:46:25.754 INFO:teuthology.orchestra.run.smithi202.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-03-06T13:46:25.754 INFO:teuthology.orchestra.run.smithi202.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-03-06T13:46:25.754 INFO:teuthology.orchestra.run.smithi202.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-03-06T13:46:25.754 INFO:teuthology.orchestra.run.smithi202.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-03-06T13:46:25.754 INFO:teuthology.orchestra.run.smithi202.stdout: python3-rsa noarch 4.8-1.el8 epel 61 k 2023-03-06T13:46:25.755 INFO:teuthology.orchestra.run.smithi202.stdout: python3-scipy x86_64 1.0.0-21.module+el8.5.0+10916+41bd434d rhel-8-for-x86_64-appstream-rpms 14 M 2023-03-06T13:46:25.755 INFO:teuthology.orchestra.run.smithi202.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-03-06T13:46:25.755 INFO:teuthology.orchestra.run.smithi202.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-03-06T13:46:25.755 INFO:teuthology.orchestra.run.smithi202.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-03-06T13:46:25.755 INFO:teuthology.orchestra.run.smithi202.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-03-06T13:46:25.755 INFO:teuthology.orchestra.run.smithi202.stdout: python3-waitress noarch 1.2.1-2.el8.1 epel 241 k 2023-03-06T13:46:25.755 INFO:teuthology.orchestra.run.smithi202.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-03-06T13:46:25.755 INFO:teuthology.orchestra.run.smithi202.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-03-06T13:46:25.756 INFO:teuthology.orchestra.run.smithi202.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-03-06T13:46:25.756 INFO:teuthology.orchestra.run.smithi202.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-03-06T13:46:25.756 INFO:teuthology.orchestra.run.smithi202.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-03-06T13:46:25.756 INFO:teuthology.orchestra.run.smithi202.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2023-03-06T13:46:25.756 INFO:teuthology.orchestra.run.smithi202.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-03-06T13:46:25.756 INFO:teuthology.orchestra.run.smithi202.stdout: uuid x86_64 1.6.2-43.el8 rhel-8-for-x86_64-appstream-rpms 64 k 2023-03-06T13:46:25.756 INFO:teuthology.orchestra.run.smithi202.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-03-06T13:46:25.757 INFO:teuthology.orchestra.run.smithi202.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2023-03-06T13:46:25.757 INFO:teuthology.orchestra.run.smithi202.stdout:Enabling module streams: 2023-03-06T13:46:25.757 INFO:teuthology.orchestra.run.smithi202.stdout: postgresql 10 2023-03-06T13:46:25.757 INFO:teuthology.orchestra.run.smithi202.stdout: 2023-03-06T13:46:25.757 INFO:teuthology.orchestra.run.smithi202.stdout:Transaction Summary 2023-03-06T13:46:25.757 INFO:teuthology.orchestra.run.smithi202.stdout:=========================================================================================================================== 2023-03-06T13:46:25.757 INFO:teuthology.orchestra.run.smithi202.stdout:Install 128 Packages 2023-03-06T13:46:25.758 INFO:teuthology.orchestra.run.smithi202.stdout:Upgrade 3 Packages 2023-03-06T13:46:25.758 INFO:teuthology.orchestra.run.smithi202.stdout: 2023-03-06T13:46:25.758 INFO:teuthology.orchestra.run.smithi202.stdout:Total download size: 203 M 2023-03-06T13:46:25.759 INFO:teuthology.orchestra.run.smithi202.stdout:Downloading Packages: 2023-03-06T13:46:25.830 INFO:teuthology.orchestra.run.smithi086.stdout:(1/131): ceph-18.0.0-2739.g472aaef4.el8.x86_64. 50 kB/s | 6.4 kB 00:00 2023-03-06T13:46:25.896 INFO:teuthology.orchestra.run.smithi202.stdout:(1/131): ceph-18.0.0-2739.g472aaef4.el8.x86_64. 45 kB/s | 6.4 kB 00:00 2023-03-06T13:46:26.331 INFO:teuthology.orchestra.run.smithi086.stdout:(2/131): ceph-fuse-18.0.0-2739.g472aaef4.el8.x8 1.7 MB/s | 845 kB 00:00 2023-03-06T13:46:26.430 INFO:teuthology.orchestra.run.smithi202.stdout:(2/131): ceph-fuse-18.0.0-2739.g472aaef4.el8.x8 1.5 MB/s | 845 kB 00:00 2023-03-06T13:46:26.447 INFO:teuthology.orchestra.run.smithi086.stdout:(3/131): ceph-immutable-object-cache-18.0.0-273 1.4 MB/s | 166 kB 00:00 2023-03-06T13:46:26.547 INFO:teuthology.orchestra.run.smithi202.stdout:(3/131): ceph-immutable-object-cache-18.0.0-273 1.4 MB/s | 166 kB 00:00 2023-03-06T13:46:26.956 INFO:teuthology.orchestra.run.smithi086.stdout:(4/131): ceph-base-18.0.0-2739.g472aaef4.el8.x8 4.3 MB/s | 5.4 MB 00:01 2023-03-06T13:46:27.448 INFO:teuthology.orchestra.run.smithi086.stdout:(5/131): ceph-mds-18.0.0-2739.g472aaef4.el8.x86 2.3 MB/s | 2.3 MB 00:01 2023-03-06T13:46:27.501 INFO:teuthology.orchestra.run.smithi086.stdout:(6/131): ceph-mgr-18.0.0-2739.g472aaef4.el8.x86 2.9 MB/s | 1.5 MB 00:00 2023-03-06T13:46:27.639 INFO:teuthology.orchestra.run.smithi202.stdout:(4/131): ceph-mds-18.0.0-2739.g472aaef4.el8.x86 2.1 MB/s | 2.3 MB 00:01 2023-03-06T13:46:27.773 INFO:teuthology.orchestra.run.smithi202.stdout:(5/131): ceph-base-18.0.0-2739.g472aaef4.el8.x8 2.7 MB/s | 5.4 MB 00:02 2023-03-06T13:46:28.564 INFO:teuthology.orchestra.run.smithi202.stdout:(6/131): ceph-mgr-18.0.0-2739.g472aaef4.el8.x86 1.7 MB/s | 1.5 MB 00:00 2023-03-06T13:46:28.709 INFO:teuthology.orchestra.run.smithi086.stdout:(7/131): ceph-common-18.0.0-2739.g472aaef4.el8. 7.2 MB/s | 22 MB 00:03 2023-03-06T13:46:28.790 INFO:teuthology.orchestra.run.smithi086.stdout:(8/131): ceph-mon-18.0.0-2739.g472aaef4.el8.x86 3.4 MB/s | 4.6 MB 00:01 2023-03-06T13:46:28.814 INFO:teuthology.orchestra.run.smithi202.stdout:(7/131): ceph-mon-18.0.0-2739.g472aaef4.el8.x86 4.4 MB/s | 4.6 MB 00:01 2023-03-06T13:46:28.840 INFO:teuthology.orchestra.run.smithi086.stdout:(9/131): ceph-selinux-18.0.0-2739.g472aaef4.el8 484 kB/s | 24 kB 00:00 2023-03-06T13:46:30.524 INFO:teuthology.orchestra.run.smithi086.stdout:(10/131): ceph-radosgw-18.0.0-2739.g472aaef4.el 7.2 MB/s | 13 MB 00:01 2023-03-06T13:46:30.616 INFO:teuthology.orchestra.run.smithi086.stdout:(11/131): cephfs-mirror-18.0.0-2739.g472aaef4.e 2.7 MB/s | 257 kB 00:00 2023-03-06T13:46:30.708 INFO:teuthology.orchestra.run.smithi086.stdout:(12/131): libcephfs-devel-18.0.0-2739.g472aaef4 333 kB/s | 30 kB 00:00 2023-03-06T13:46:30.875 INFO:teuthology.orchestra.run.smithi086.stdout:(13/131): libcephfs2-18.0.0-2739.g472aaef4.el8. 4.5 MB/s | 767 kB 00:00 2023-03-06T13:46:30.881 INFO:teuthology.orchestra.run.smithi202.stdout:(8/131): ceph-common-18.0.0-2739.g472aaef4.el8. 4.2 MB/s | 22 MB 00:05 2023-03-06T13:46:30.967 INFO:teuthology.orchestra.run.smithi086.stdout:(14/131): libcephsqlite-18.0.0-2739.g472aaef4.e 1.5 MB/s | 137 kB 00:00 2023-03-06T13:46:30.981 INFO:teuthology.orchestra.run.smithi202.stdout:(9/131): ceph-selinux-18.0.0-2739.g472aaef4.el8 244 kB/s | 24 kB 00:00 2023-03-06T13:46:31.042 INFO:teuthology.orchestra.run.smithi086.stdout:(15/131): librados-devel-18.0.0-2739.g472aaef4. 1.8 MB/s | 139 kB 00:00 2023-03-06T13:46:31.648 INFO:teuthology.orchestra.run.smithi202.stdout:(10/131): ceph-radosgw-18.0.0-2739.g472aaef4.el 4.6 MB/s | 13 MB 00:02 2023-03-06T13:46:31.724 INFO:teuthology.orchestra.run.smithi202.stdout:(11/131): cephfs-mirror-18.0.0-2739.g472aaef4.e 3.4 MB/s | 257 kB 00:00 2023-03-06T13:46:31.758 INFO:teuthology.orchestra.run.smithi202.stdout:(12/131): libcephfs-devel-18.0.0-2739.g472aaef4 916 kB/s | 30 kB 00:00 2023-03-06T13:46:31.801 INFO:teuthology.orchestra.run.smithi086.stdout:(16/131): ceph-osd-18.0.0-2739.g472aaef4.el8.x8 4.1 MB/s | 18 MB 00:04 2023-03-06T13:46:31.826 INFO:teuthology.orchestra.run.smithi086.stdout:(17/131): libradosstriper1-18.0.0-2739.g472aaef 605 kB/s | 474 kB 00:00 2023-03-06T13:46:31.876 INFO:teuthology.orchestra.run.smithi086.stdout:(18/131): python3-ceph-argparse-18.0.0-2739.g47 897 kB/s | 45 kB 00:00 2023-03-06T13:46:31.883 INFO:teuthology.orchestra.run.smithi202.stdout:(13/131): libcephfs2-18.0.0-2739.g472aaef4.el8. 6.0 MB/s | 767 kB 00:00 2023-03-06T13:46:31.918 INFO:teuthology.orchestra.run.smithi086.stdout:(19/131): python3-ceph-common-18.0.0-2739.g472a 2.8 MB/s | 117 kB 00:00 2023-03-06T13:46:31.949 INFO:teuthology.orchestra.run.smithi202.stdout:(14/131): libcephsqlite-18.0.0-2739.g472aaef4.e 2.0 MB/s | 137 kB 00:00 2023-03-06T13:46:31.977 INFO:teuthology.orchestra.run.smithi086.stdout:(20/131): python3-cephfs-18.0.0-2739.g472aaef4. 3.2 MB/s | 190 kB 00:00 2023-03-06T13:46:32.008 INFO:teuthology.orchestra.run.smithi202.stdout:(15/131): librados-devel-18.0.0-2739.g472aaef4. 2.3 MB/s | 139 kB 00:00 2023-03-06T13:46:32.085 INFO:teuthology.orchestra.run.smithi086.stdout:(21/131): python3-rados-18.0.0-2739.g472aaef4.e 3.4 MB/s | 371 kB 00:00 2023-03-06T13:46:32.197 INFO:teuthology.orchestra.run.smithi202.stdout:(16/131): libradosstriper1-18.0.0-2739.g472aaef 4.3 MB/s | 474 kB 00:00 2023-03-06T13:46:32.198 INFO:teuthology.orchestra.run.smithi086.stdout:(22/131): python3-rbd-18.0.0-2739.g472aaef4.el8 3.3 MB/s | 364 kB 00:00 2023-03-06T13:46:32.261 INFO:teuthology.orchestra.run.smithi086.stdout:(23/131): python3-rgw-18.0.0-2739.g472aaef4.el8 1.6 MB/s | 107 kB 00:00 2023-03-06T13:46:32.328 INFO:teuthology.orchestra.run.smithi086.stdout:(24/131): rbd-fuse-18.0.0-2739.g472aaef4.el8.x8 1.4 MB/s | 94 kB 00:00 2023-03-06T13:46:32.903 INFO:teuthology.orchestra.run.smithi086.stdout:(25/131): rbd-mirror-18.0.0-2739.g472aaef4.el8. 6.0 MB/s | 3.4 MB 00:00 2023-03-06T13:46:32.970 INFO:teuthology.orchestra.run.smithi086.stdout:(26/131): rbd-nbd-18.0.0-2739.g472aaef4.el8.x86 2.6 MB/s | 180 kB 00:00 2023-03-06T13:46:33.029 INFO:teuthology.orchestra.run.smithi086.stdout:(27/131): ceph-grafana-dashboards-18.0.0-2739.g 394 kB/s | 23 kB 00:00 2023-03-06T13:46:33.087 INFO:teuthology.orchestra.run.smithi086.stdout:(28/131): ceph-mgr-cephadm-18.0.0-2739.g472aaef 2.1 MB/s | 123 kB 00:00 2023-03-06T13:46:33.162 INFO:teuthology.orchestra.run.smithi086.stdout:(29/131): librgw2-18.0.0-2739.g472aaef4.el8.x86 4.8 MB/s | 6.5 MB 00:01 2023-03-06T13:46:33.268 INFO:teuthology.orchestra.run.smithi202.stdout:(17/131): librgw2-18.0.0-2739.g472aaef4.el8.x86 5.6 MB/s | 6.5 MB 00:01 2023-03-06T13:46:33.334 INFO:teuthology.orchestra.run.smithi202.stdout:(18/131): python3-ceph-argparse-18.0.0-2739.g47 671 kB/s | 45 kB 00:00 2023-03-06T13:46:33.338 INFO:teuthology.orchestra.run.smithi086.stdout:(30/131): ceph-mgr-dashboard-18.0.0-2739.g472aa 6.9 MB/s | 1.7 MB 00:00 2023-03-06T13:46:33.393 INFO:teuthology.orchestra.run.smithi202.stdout:(19/131): python3-ceph-common-18.0.0-2739.g472a 2.0 MB/s | 117 kB 00:00 2023-03-06T13:46:33.405 INFO:teuthology.orchestra.run.smithi086.stdout:(31/131): ceph-mgr-modules-core-18.0.0-2739.g47 3.5 MB/s | 236 kB 00:00 2023-03-06T13:46:33.443 INFO:teuthology.orchestra.run.smithi202.stdout:(20/131): python3-cephfs-18.0.0-2739.g472aaef4. 3.7 MB/s | 190 kB 00:00 2023-03-06T13:46:33.463 INFO:teuthology.orchestra.run.smithi086.stdout:(32/131): ceph-mgr-rook-18.0.0-2739.g472aaef4.e 815 kB/s | 47 kB 00:00 2023-03-06T13:46:33.530 INFO:teuthology.orchestra.run.smithi086.stdout:(33/131): ceph-prometheus-alerts-18.0.0-2739.g4 218 kB/s | 15 kB 00:00 2023-03-06T13:46:33.569 INFO:teuthology.orchestra.run.smithi202.stdout:(21/131): python3-rados-18.0.0-2739.g472aaef4.e 2.9 MB/s | 371 kB 00:00 2023-03-06T13:46:33.581 INFO:teuthology.orchestra.run.smithi086.stdout:(34/131): ceph-volume-18.0.0-2739.g472aaef4.el8 5.1 MB/s | 263 kB 00:00 2023-03-06T13:46:33.648 INFO:teuthology.orchestra.run.smithi086.stdout:(35/131): cephadm-18.0.0-2739.g472aaef4.el8.noa 1.2 MB/s | 83 kB 00:00 2023-03-06T13:46:33.677 INFO:teuthology.orchestra.run.smithi202.stdout:(22/131): python3-rbd-18.0.0-2739.g472aaef4.el8 3.3 MB/s | 364 kB 00:00 2023-03-06T13:46:33.698 INFO:teuthology.orchestra.run.smithi086.stdout:(36/131): cephfs-top-18.0.0-2739.g472aaef4.el8. 361 kB/s | 18 kB 00:00 2023-03-06T13:46:33.736 INFO:teuthology.orchestra.run.smithi202.stdout:(23/131): python3-rgw-18.0.0-2739.g472aaef4.el8 1.8 MB/s | 107 kB 00:00 2023-03-06T13:46:33.795 INFO:teuthology.orchestra.run.smithi202.stdout:(24/131): rbd-fuse-18.0.0-2739.g472aaef4.el8.x8 1.6 MB/s | 94 kB 00:00 2023-03-06T13:46:33.898 INFO:teuthology.orchestra.run.smithi086.stdout:(37/131): gperftools-libs-2.7-9.el8.x86_64.rpm 1.5 MB/s | 306 kB 00:00 2023-03-06T13:46:33.948 INFO:teuthology.orchestra.run.smithi086.stdout:(38/131): liboath-2.6.2-3.el8.x86_64.rpm 1.1 MB/s | 59 kB 00:00 2023-03-06T13:46:34.007 INFO:teuthology.orchestra.run.smithi086.stdout:(39/131): libunwind-1.3.1-3.el8.x86_64.rpm 1.3 MB/s | 75 kB 00:00 2023-03-06T13:46:34.141 INFO:teuthology.orchestra.run.smithi086.stdout:(40/131): python3-asyncssh-2.7.0-2.el8.noarch.r 3.5 MB/s | 476 kB 00:00 2023-03-06T13:46:34.224 INFO:teuthology.orchestra.run.smithi086.stdout:(41/131): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 524 kB/s | 44 kB 00:00 2023-03-06T13:46:34.283 INFO:teuthology.orchestra.run.smithi086.stdout:(42/131): python3-beautifulsoup4-4.6.3-2.el8.1. 3.1 MB/s | 185 kB 00:00 2023-03-06T13:46:34.350 INFO:teuthology.orchestra.run.smithi086.stdout:(43/131): python3-cachetools-3.1.1-4.el8.noarch 496 kB/s | 33 kB 00:00 2023-03-06T13:46:34.362 INFO:teuthology.orchestra.run.smithi202.stdout:(25/131): rbd-mirror-18.0.0-2739.g472aaef4.el8. 6.1 MB/s | 3.4 MB 00:00 2023-03-06T13:46:34.420 INFO:teuthology.orchestra.run.smithi202.stdout:(26/131): rbd-nbd-18.0.0-2739.g472aaef4.el8.x86 3.0 MB/s | 180 kB 00:00 2023-03-06T13:46:34.459 INFO:teuthology.orchestra.run.smithi086.stdout:(44/131): ceph-mgr-diskprediction-local-18.0.0- 5.7 MB/s | 7.4 MB 00:01 2023-03-06T13:46:34.479 INFO:teuthology.orchestra.run.smithi202.stdout:(27/131): ceph-grafana-dashboards-18.0.0-2739.g 395 kB/s | 23 kB 00:00 2023-03-06T13:46:34.484 INFO:teuthology.orchestra.run.smithi086.stdout:(45/131): python3-certifi-2018.10.15-7.el8.noar 122 kB/s | 16 kB 00:00 2023-03-06T13:46:34.538 INFO:teuthology.orchestra.run.smithi202.stdout:(28/131): ceph-mgr-cephadm-18.0.0-2739.g472aaef 2.1 MB/s | 123 kB 00:00 2023-03-06T13:46:34.567 INFO:teuthology.orchestra.run.smithi086.stdout:(46/131): python3-cherrypy-18.4.0-1.el8.noarch. 4.5 MB/s | 384 kB 00:00 2023-03-06T13:46:34.618 INFO:teuthology.orchestra.run.smithi086.stdout:(47/131): python3-google-auth-1.1.1-10.el8.noar 1.6 MB/s | 81 kB 00:00 2023-03-06T13:46:34.643 INFO:teuthology.orchestra.run.smithi086.stdout:(48/131): python3-cheroot-8.5.2-1.el8.noarch.rp 939 kB/s | 173 kB 00:00 2023-03-06T13:46:34.668 INFO:teuthology.orchestra.run.smithi086.stdout:(49/131): python3-jaraco-6.2-6.el8.noarch.rpm 221 kB/s | 11 kB 00:00 2023-03-06T13:46:34.694 INFO:teuthology.orchestra.run.smithi086.stdout:(50/131): python3-jaraco-functools-2.0-4.el8.no 350 kB/s | 18 kB 00:00 2023-03-06T13:46:34.777 INFO:teuthology.orchestra.run.smithi086.stdout:(51/131): python3-logutils-0.3.5-11.el8.noarch. 586 kB/s | 49 kB 00:00 2023-03-06T13:46:34.853 INFO:teuthology.orchestra.run.smithi086.stdout:(52/131): python3-more-itertools-7.2.0-3.el8.no 785 kB/s | 59 kB 00:00 2023-03-06T13:46:34.863 INFO:teuthology.orchestra.run.smithi202.stdout:(29/131): ceph-osd-18.0.0-2739.g472aaef4.el8.x8 2.8 MB/s | 18 MB 00:06 2023-03-06T13:46:34.913 INFO:teuthology.orchestra.run.smithi202.stdout:(30/131): ceph-mgr-dashboard-18.0.0-2739.g472aa 4.6 MB/s | 1.7 MB 00:00 2023-03-06T13:46:34.952 INFO:teuthology.orchestra.run.smithi086.stdout:(53/131): python3-natsort-7.1.1-2.el8.noarch.rp 604 kB/s | 60 kB 00:00 2023-03-06T13:46:34.972 INFO:teuthology.orchestra.run.smithi202.stdout:(31/131): ceph-mgr-modules-core-18.0.0-2739.g47 4.0 MB/s | 236 kB 00:00 2023-03-06T13:46:35.019 INFO:teuthology.orchestra.run.smithi086.stdout:(54/131): python3-kubernetes-11.0.0-6.el8.noarc 3.3 MB/s | 1.2 MB 00:00 2023-03-06T13:46:35.022 INFO:teuthology.orchestra.run.smithi202.stdout:(32/131): ceph-mgr-rook-18.0.0-2739.g472aaef4.e 947 kB/s | 47 kB 00:00 2023-03-06T13:46:35.073 INFO:teuthology.orchestra.run.smithi202.stdout:(33/131): ceph-prometheus-alerts-18.0.0-2739.g4 291 kB/s | 15 kB 00:00 2023-03-06T13:46:35.095 INFO:teuthology.orchestra.run.smithi086.stdout:(55/131): python3-portend-2.6-1.el8.noarch.rpm 208 kB/s | 16 kB 00:00 2023-03-06T13:46:35.131 INFO:teuthology.orchestra.run.smithi202.stdout:(34/131): ceph-volume-18.0.0-2739.g472aaef4.el8 4.4 MB/s | 263 kB 00:00 2023-03-06T13:46:35.153 INFO:teuthology.orchestra.run.smithi086.stdout:(56/131): python3-pecan-1.3.2-9.el8.noarch.rpm 1.4 MB/s | 283 kB 00:00 2023-03-06T13:46:35.170 INFO:teuthology.orchestra.run.smithi086.stdout:(57/131): python3-repoze-lru-0.7-6.el8.noarch.r 447 kB/s | 34 kB 00:00 2023-03-06T13:46:35.182 INFO:teuthology.orchestra.run.smithi202.stdout:(35/131): cephadm-18.0.0-2739.g472aaef4.el8.noa 1.6 MB/s | 83 kB 00:00 2023-03-06T13:46:35.220 INFO:teuthology.orchestra.run.smithi086.stdout:(58/131): python3-rsa-4.8-1.el8.noarch.rpm 1.2 MB/s | 61 kB 00:00 2023-03-06T13:46:35.224 INFO:teuthology.orchestra.run.smithi202.stdout:(36/131): cephfs-top-18.0.0-2739.g472aaef4.el8. 432 kB/s | 18 kB 00:00 2023-03-06T13:46:35.254 INFO:teuthology.orchestra.run.smithi086.stdout:(59/131): python3-routes-2.4.1-12.el8.noarch.rp 1.9 MB/s | 196 kB 00:00 2023-03-06T13:46:35.271 INFO:teuthology.orchestra.run.smithi086.stdout:(60/131): python3-simplegeneric-0.8.1-17.el8.no 373 kB/s | 19 kB 00:00 2023-03-06T13:46:35.313 INFO:teuthology.orchestra.run.smithi086.stdout:(61/131): python3-singledispatch-3.4.0.3-18.el8 409 kB/s | 24 kB 00:00 2023-03-06T13:46:35.330 INFO:teuthology.orchestra.run.smithi086.stdout:(62/131): python3-tempora-1.14.1-5.el8.noarch.r 498 kB/s | 29 kB 00:00 2023-03-06T13:46:35.363 INFO:teuthology.orchestra.run.smithi086.stdout:(63/131): python3-trustme-0.6.0-4.el8.noarch.rp 551 kB/s | 27 kB 00:00 2023-03-06T13:46:35.388 INFO:teuthology.orchestra.run.smithi086.stdout:(64/131): python3-waitress-1.2.1-2.el8.1.noarch 4.0 MB/s | 241 kB 00:00 2023-03-06T13:46:35.447 INFO:teuthology.orchestra.run.smithi086.stdout:(65/131): python3-websocket-client-0.56.0-5.el8 1.0 MB/s | 61 kB 00:00 2023-03-06T13:46:35.472 INFO:teuthology.orchestra.run.smithi086.stdout:(66/131): python3-webob-1.8.5-1.el8.1.noarch.rp 2.3 MB/s | 251 kB 00:00 2023-03-06T13:46:35.491 INFO:teuthology.orchestra.run.smithi202.stdout:(37/131): gperftools-libs-2.7-9.el8.x86_64.rpm 1.1 MB/s | 306 kB 00:00 2023-03-06T13:46:35.514 INFO:teuthology.orchestra.run.smithi086.stdout:(67/131): python3-webtest-2.0.33-1.el8.noarch.r 1.2 MB/s | 85 kB 00:00 2023-03-06T13:46:35.531 INFO:teuthology.orchestra.run.smithi086.stdout:(68/131): python3-zc-lockfile-2.0-2.el8.noarch. 392 kB/s | 23 kB 00:00 2023-03-06T13:46:35.557 INFO:teuthology.orchestra.run.smithi086.stdout:(69/131): xmlstarlet-1.6.1-20.el8.x86_64.rpm 2.7 MB/s | 70 kB 00:00 2023-03-06T13:46:35.558 INFO:teuthology.orchestra.run.smithi202.stdout:(38/131): liboath-2.6.2-3.el8.x86_64.rpm 886 kB/s | 59 kB 00:00 2023-03-06T13:46:35.625 INFO:teuthology.orchestra.run.smithi202.stdout:(39/131): libunwind-1.3.1-3.el8.x86_64.rpm 1.1 MB/s | 75 kB 00:00 2023-03-06T13:46:35.849 INFO:teuthology.orchestra.run.smithi086.stdout:(70/131): python3-scipy-1.0.0-21.module+el8.5.0 47 MB/s | 14 MB 00:00 2023-03-06T13:46:35.882 INFO:teuthology.orchestra.run.smithi086.stdout:(71/131): python3-pyasn1-modules-0.3.7-6.el8.no 3.3 MB/s | 110 kB 00:00 2023-03-06T13:46:35.892 INFO:teuthology.orchestra.run.smithi202.stdout:(40/131): python3-asyncssh-2.7.0-2.el8.noarch.r 1.7 MB/s | 476 kB 00:00 2023-03-06T13:46:35.924 INFO:teuthology.orchestra.run.smithi086.stdout:(72/131): python3-pytz-2017.2-9.el8.noarch.rpm 1.3 MB/s | 54 kB 00:00 2023-03-06T13:46:35.959 INFO:teuthology.orchestra.run.smithi202.stdout:(41/131): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 656 kB/s | 44 kB 00:00 2023-03-06T13:46:35.966 INFO:teuthology.orchestra.run.smithi086.stdout:(73/131): thrift-0.13.0-2.el8.x86_64.rpm 3.8 MB/s | 1.7 MB 00:00 2023-03-06T13:46:35.983 INFO:teuthology.orchestra.run.smithi086.stdout:(74/131): lttng-ust-2.8.1-11.el8.x86_64.rpm 4.3 MB/s | 259 kB 00:00 2023-03-06T13:46:36.050 INFO:teuthology.orchestra.run.smithi086.stdout:(75/131): python3-markupsafe-0.23-19.el8.x86_64 633 kB/s | 39 kB 00:00 2023-03-06T13:46:36.076 INFO:teuthology.orchestra.run.smithi086.stdout:(76/131): socat-1.7.4.1-1.el8.x86_64.rpm 2.9 MB/s | 323 kB 00:00 2023-03-06T13:46:36.109 INFO:teuthology.orchestra.run.smithi086.stdout:(77/131): bison-3.0.4-10.el8.x86_64.rpm 11 MB/s | 688 kB 00:00 2023-03-06T13:46:36.134 INFO:teuthology.orchestra.run.smithi202.stdout:(42/131): ceph-mgr-diskprediction-local-18.0.0- 5.8 MB/s | 7.4 MB 00:01 2023-03-06T13:46:36.151 INFO:teuthology.orchestra.run.smithi086.stdout:(78/131): python3-jinja2-2.10.1-3.el8.noarch.rp 7.0 MB/s | 538 kB 00:00 2023-03-06T13:46:36.176 INFO:teuthology.orchestra.run.smithi086.stdout:(79/131): python3-mako-1.0.6-13.el8.noarch.rpm 2.3 MB/s | 157 kB 00:00 2023-03-06T13:46:36.193 INFO:teuthology.orchestra.run.smithi086.stdout:(80/131): oniguruma-6.8.2-2.el8.x86_64.rpm 4.4 MB/s | 187 kB 00:00 2023-03-06T13:46:36.227 INFO:teuthology.orchestra.run.smithi086.stdout:(81/131): automake-1.16.1-7.el8.noarch.rpm 14 MB/s | 713 kB 00:00 2023-03-06T13:46:36.269 INFO:teuthology.orchestra.run.smithi086.stdout:(82/131): python3-jsonpatch-1.21-2.el8.noarch.r 637 kB/s | 27 kB 00:00 2023-03-06T13:46:36.319 INFO:teuthology.orchestra.run.smithi086.stdout:(83/131): flex-2.6.1-9.el8.x86_64.rpm 6.3 MB/s | 320 kB 00:00 2023-03-06T13:46:36.394 INFO:teuthology.orchestra.run.smithi086.stdout:(84/131): python3-babel-2.5.1-7.el8.noarch.rpm 24 MB/s | 4.8 MB 00:00 2023-03-06T13:46:36.419 INFO:teuthology.orchestra.run.smithi086.stdout:(85/131): python3-prettytable-0.7.2-14.el8.noar 439 kB/s | 44 kB 00:00 2023-03-06T13:46:36.435 INFO:teuthology.orchestra.run.smithi202.stdout:(43/131): python3-cachetools-3.1.1-4.el8.noarch 110 kB/s | 33 kB 00:00 2023-03-06T13:46:36.461 INFO:teuthology.orchestra.run.smithi086.stdout:(86/131): python3-werkzeug-0.12.2-4.el8.noarch. 11 MB/s | 457 kB 00:00 2023-03-06T13:46:36.503 INFO:teuthology.orchestra.run.smithi086.stdout:(87/131): python3-numpy-f2py-1.14.3-10.el8.x86_ 5.3 MB/s | 225 kB 00:00 2023-03-06T13:46:36.527 INFO:teuthology.orchestra.run.smithi202.stdout:(44/131): python3-certifi-2018.10.15-7.el8.noar 178 kB/s | 16 kB 00:00 2023-03-06T13:46:36.562 INFO:teuthology.orchestra.run.smithi086.stdout:(88/131): python3-numpy-1.14.3-10.el8.x86_64.rp 22 MB/s | 3.7 MB 00:00 2023-03-06T13:46:36.587 INFO:teuthology.orchestra.run.smithi086.stdout:(89/131): uuid-1.6.2-43.el8.x86_64.rpm 767 kB/s | 64 kB 00:00 2023-03-06T13:46:36.613 INFO:teuthology.orchestra.run.smithi086.stdout:(90/131): python3-pyasn1-0.3.7-6.el8.noarch.rpm 2.5 MB/s | 126 kB 00:00 2023-03-06T13:46:36.637 INFO:teuthology.orchestra.run.smithi086.stdout:(91/131): python3-jsonpointer-1.10-11.el8.noarc 398 kB/s | 20 kB 00:00 2023-03-06T13:46:36.663 INFO:teuthology.orchestra.run.smithi086.stdout:(92/131): python3-pyOpenSSL-19.0.0-1.el8.noarch 2.0 MB/s | 103 kB 00:00 2023-03-06T13:46:36.696 INFO:teuthology.orchestra.run.smithi086.stdout:(93/131): libtool-2.4.6-25.el8.x86_64.rpm 12 MB/s | 709 kB 00:00 2023-03-06T13:46:36.738 INFO:teuthology.orchestra.run.smithi086.stdout:(94/131): libpq-13.5-1.el8.x86_64.rpm 4.6 MB/s | 198 kB 00:00 2023-03-06T13:46:36.830 INFO:teuthology.orchestra.run.smithi086.stdout:(95/131): openblas-threads-0.3.15-3.el8.x86_64. 29 MB/s | 4.9 MB 00:00 2023-03-06T13:46:36.935 INFO:teuthology.orchestra.run.smithi202.stdout:(45/131): ceph-test-18.0.0-2739.g472aaef4.el8.x 7.8 MB/s | 47 MB 00:05 2023-03-06T13:46:36.961 INFO:teuthology.orchestra.run.smithi202.stdout:(46/131): python3-beautifulsoup4-4.6.3-2.el8.1. 185 kB/s | 185 kB 00:01 2023-03-06T13:46:36.986 INFO:teuthology.orchestra.run.smithi202.stdout:(47/131): python3-cheroot-8.5.2-1.el8.noarch.rp 376 kB/s | 173 kB 00:00 2023-03-06T13:46:37.069 INFO:teuthology.orchestra.run.smithi202.stdout:(48/131): python3-jaraco-6.2-6.el8.noarch.rpm 133 kB/s | 11 kB 00:00 2023-03-06T13:46:37.120 INFO:teuthology.orchestra.run.smithi202.stdout:(49/131): python3-google-auth-1.1.1-10.el8.noar 511 kB/s | 81 kB 00:00 2023-03-06T13:46:37.145 INFO:teuthology.orchestra.run.smithi202.stdout:(50/131): python3-jaraco-functools-2.0-4.el8.no 233 kB/s | 18 kB 00:00 2023-03-06T13:46:37.254 INFO:teuthology.orchestra.run.smithi202.stdout:(51/131): python3-logutils-0.3.5-11.el8.noarch. 450 kB/s | 49 kB 00:00 2023-03-06T13:46:37.281 INFO:teuthology.orchestra.run.smithi086.stdout:(96/131): ceph-test-18.0.0-2739.g472aaef4.el8.x 5.5 MB/s | 47 MB 00:08 2023-03-06T13:46:37.306 INFO:teuthology.orchestra.run.smithi086.stdout:(97/131): jq-1.6-3.el8.x86_64.rpm 425 kB/s | 202 kB 00:00 2023-03-06T13:46:37.356 INFO:teuthology.orchestra.run.smithi086.stdout:(98/131): librdkafka-0.11.4-3.el8.x86_64.rpm 4.6 MB/s | 354 kB 00:00 2023-03-06T13:46:37.405 INFO:teuthology.orchestra.run.smithi202.stdout:(52/131): python3-more-itertools-7.2.0-3.el8.no 391 kB/s | 59 kB 00:00 2023-03-06T13:46:37.432 INFO:teuthology.orchestra.run.smithi086.stdout:(99/131): openblas-0.3.15-3.el8.x86_64.rpm 6.8 MB/s | 4.7 MB 00:00 2023-03-06T13:46:37.482 INFO:teuthology.orchestra.run.smithi086.stdout:(100/131): postgresql-contrib-10.21-2.module+el 6.3 MB/s | 808 kB 00:00 2023-03-06T13:46:37.507 INFO:teuthology.orchestra.run.smithi086.stdout:(101/131): librabbitmq-0.9.0-3.el8.x86_64.rpm 1.8 MB/s | 47 kB 00:00 2023-03-06T13:46:37.549 INFO:teuthology.orchestra.run.smithi086.stdout:(102/131): postgresql-10.21-2.module+el8.6.0+15 13 MB/s | 1.5 MB 00:00 2023-03-06T13:46:37.563 INFO:teuthology.orchestra.run.smithi202.stdout:(53/131): python3-natsort-7.1.1-2.el8.noarch.rp 381 kB/s | 60 kB 00:00 2023-03-06T13:46:37.574 INFO:teuthology.orchestra.run.smithi086.stdout:(103/131): libselinux-devel-2.9-5.el8.x86_64.rp 2.9 MB/s | 200 kB 00:00 2023-03-06T13:46:37.600 INFO:teuthology.orchestra.run.smithi086.stdout:(104/131): python3-jwt-1.6.1-2.el8.noarch.rpm 849 kB/s | 43 kB 00:00 2023-03-06T13:46:37.625 INFO:teuthology.orchestra.run.smithi086.stdout:(105/131): pcre2-utf32-10.32-2.el8.x86_64.rpm 4.3 MB/s | 220 kB 00:00 2023-03-06T13:46:37.650 INFO:teuthology.orchestra.run.smithi086.stdout:(106/131): keyutils-libs-devel-1.5.10-9.el8.x86 958 kB/s | 48 kB 00:00 2023-03-06T13:46:37.676 INFO:teuthology.orchestra.run.smithi086.stdout:(107/131): libsepol-devel-2.9-3.el8.x86_64.rpm 1.7 MB/s | 87 kB 00:00 2023-03-06T13:46:37.701 INFO:teuthology.orchestra.run.smithi086.stdout:(108/131): python3-requests-oauthlib-1.0.0-1.el 850 kB/s | 43 kB 00:00 2023-03-06T13:46:37.705 INFO:teuthology.orchestra.run.smithi202.stdout:(54/131): python3-kubernetes-11.0.0-6.el8.noarc 2.0 MB/s | 1.2 MB 00:00 2023-03-06T13:46:37.726 INFO:teuthology.orchestra.run.smithi086.stdout:(109/131): python3-pycparser-2.14-14.el8.noarch 2.1 MB/s | 109 kB 00:00 2023-03-06T13:46:37.752 INFO:teuthology.orchestra.run.smithi086.stdout:(110/131): pcre2-utf16-10.32-2.el8.x86_64.rpm 4.5 MB/s | 229 kB 00:00 2023-03-06T13:46:37.785 INFO:teuthology.orchestra.run.smithi086.stdout:(111/131): krb5-devel-1.18.2-14.el8.x86_64.rpm 9.4 MB/s | 560 kB 00:00 2023-03-06T13:46:37.797 INFO:teuthology.orchestra.run.smithi202.stdout:(55/131): python3-portend-2.6-1.el8.noarch.rpm 170 kB/s | 16 kB 00:00 2023-03-06T13:46:37.810 INFO:teuthology.orchestra.run.smithi086.stdout:(112/131): libaio-devel-0.3.112-1.el8.x86_64.rp 320 kB/s | 19 kB 00:00 2023-03-06T13:46:37.822 INFO:teuthology.orchestra.run.smithi202.stdout:(56/131): python3-cherrypy-18.4.0-1.el8.noarch. 434 kB/s | 384 kB 00:00 2023-03-06T13:46:37.836 INFO:teuthology.orchestra.run.smithi086.stdout:(113/131): python3-oauthlib-2.1.0-1.el8.noarch. 3.0 MB/s | 155 kB 00:00 2023-03-06T13:46:37.889 INFO:teuthology.orchestra.run.smithi202.stdout:(57/131): python3-repoze-lru-0.7-6.el8.noarch.r 366 kB/s | 34 kB 00:00 2023-03-06T13:46:37.903 INFO:teuthology.orchestra.run.smithi086.stdout:(114/131): postgresql-server-10.21-2.module+el8 8.6 MB/s | 5.1 MB 00:00 2023-03-06T13:46:37.928 INFO:teuthology.orchestra.run.smithi086.stdout:(115/131): libverto-devel-0.3.0-5.el8.x86_64.rp 195 kB/s | 18 kB 00:00 2023-03-06T13:46:37.931 INFO:teuthology.orchestra.run.smithi202.stdout:(58/131): python3-pecan-1.3.2-9.el8.noarch.rpm 769 kB/s | 283 kB 00:00 2023-03-06T13:46:37.961 INFO:teuthology.orchestra.run.smithi086.stdout:(116/131): python3-cryptography-3.2.1-5.el8.x86 3.6 MB/s | 559 kB 00:00 2023-03-06T13:46:37.986 INFO:teuthology.orchestra.run.smithi086.stdout:(117/131): python3-cffi-1.11.5-5.el8.x86_64.rpm 4.0 MB/s | 238 kB 00:00 2023-03-06T13:46:37.989 INFO:teuthology.orchestra.run.smithi202.stdout:(59/131): python3-rsa-4.8-1.el8.noarch.rpm 613 kB/s | 61 kB 00:00 2023-03-06T13:46:38.015 INFO:teuthology.orchestra.run.smithi202.stdout:(60/131): python3-simplegeneric-0.8.1-17.el8.no 224 kB/s | 19 kB 00:00 2023-03-06T13:46:38.020 INFO:teuthology.orchestra.run.smithi086.stdout:(118/131): pcre2-devel-10.32-2.el8.x86_64.rpm 5.0 MB/s | 605 kB 00:00 2023-03-06T13:46:38.037 INFO:teuthology.orchestra.run.smithi086.stdout:(119/131): xfsprogs-devel-5.0.0-10.el8.x86_64.r 1.4 MB/s | 72 kB 00:00 2023-03-06T13:46:38.048 INFO:teuthology.orchestra.run.smithi202.stdout:(61/131): python3-singledispatch-3.4.0.3-18.el8 408 kB/s | 24 kB 00:00 2023-03-06T13:46:38.062 INFO:teuthology.orchestra.run.smithi086.stdout:(120/131): fuse-2.9.7-15.el8.x86_64.rpm 1.9 MB/s | 83 kB 00:00 2023-03-06T13:46:38.074 INFO:teuthology.orchestra.run.smithi202.stdout:(62/131): python3-routes-2.4.1-12.el8.noarch.rp 781 kB/s | 196 kB 00:00 2023-03-06T13:46:38.088 INFO:teuthology.orchestra.run.smithi086.stdout:(121/131): elfutils-libelf-devel-0.186-1.el8.x8 1.2 MB/s | 60 kB 00:00 2023-03-06T13:46:38.099 INFO:teuthology.orchestra.run.smithi202.stdout:(63/131): python3-tempora-1.14.1-5.el8.noarch.r 350 kB/s | 29 kB 00:00 2023-03-06T13:46:38.113 INFO:teuthology.orchestra.run.smithi086.stdout:(122/131): libuuid-devel-2.32.1-35.el8.x86_64.r 1.9 MB/s | 98 kB 00:00 2023-03-06T13:46:38.124 INFO:teuthology.orchestra.run.smithi202.stdout:(64/131): python3-trustme-0.6.0-4.el8.noarch.rp 365 kB/s | 27 kB 00:00 2023-03-06T13:46:38.138 INFO:teuthology.orchestra.run.smithi086.stdout:(123/131): zlib-devel-1.2.11-18.el8_5.x86_64.rp 1.1 MB/s | 58 kB 00:00 2023-03-06T13:46:38.164 INFO:teuthology.orchestra.run.smithi086.stdout:(124/131): libcom_err-devel-1.45.6-4.el8.x86_64 770 kB/s | 39 kB 00:00 2023-03-06T13:46:38.183 INFO:teuthology.orchestra.run.smithi202.stdout:(65/131): python3-websocket-client-0.56.0-5.el8 1.0 MB/s | 61 kB 00:00 2023-03-06T13:46:38.197 INFO:teuthology.orchestra.run.smithi086.stdout:(125/131): libgfortran-8.5.0-10.1.el8_6.x86_64. 11 MB/s | 644 kB 00:00 2023-03-06T13:46:38.223 INFO:teuthology.orchestra.run.smithi086.stdout:(126/131): libquadmath-8.5.0-10.1.el8_6.x86_64. 2.9 MB/s | 171 kB 00:00 2023-03-06T13:46:38.239 INFO:teuthology.orchestra.run.smithi086.stdout:(127/131): NetworkManager-initscripts-updown-1. 3.2 MB/s | 138 kB 00:00 2023-03-06T13:46:38.241 INFO:teuthology.orchestra.run.smithi202.stdout:(66/131): python3-webtest-2.0.33-1.el8.noarch.r 1.4 MB/s | 85 kB 00:00 2023-03-06T13:46:38.267 INFO:teuthology.orchestra.run.smithi202.stdout:(67/131): python3-waitress-1.2.1-2.el8.1.noarch 1.4 MB/s | 241 kB 00:00 2023-03-06T13:46:38.290 INFO:teuthology.orchestra.run.smithi086.stdout:(128/131): openssl-devel-1.1.1k-7.el8_6.x86_64. 7.1 MB/s | 2.3 MB 00:00 2023-03-06T13:46:38.292 INFO:teuthology.orchestra.run.smithi202.stdout:(68/131): python3-webob-1.8.5-1.el8.1.noarch.rp 1.3 MB/s | 251 kB 00:00 2023-03-06T13:46:38.318 INFO:teuthology.orchestra.run.smithi202.stdout:(69/131): python3-zc-lockfile-2.0-2.el8.noarch. 303 kB/s | 23 kB 00:00 2023-03-06T13:46:38.335 INFO:teuthology.orchestra.run.smithi202.stdout:(70/131): xmlstarlet-1.6.1-20.el8.x86_64.rpm 1.6 MB/s | 70 kB 00:00 2023-03-06T13:46:38.365 INFO:teuthology.orchestra.run.smithi086.stdout:(129/131): iproute-5.15.0-4.el8_6.1.x86_64.rpm 10 MB/s | 798 kB 00:00 2023-03-06T13:46:38.410 INFO:teuthology.orchestra.run.smithi202.stdout:(71/131): python3-pyasn1-modules-0.3.7-6.el8.no 1.6 MB/s | 110 kB 00:00 2023-03-06T13:46:38.436 INFO:teuthology.orchestra.run.smithi202.stdout:(72/131): python3-pytz-2017.2-9.el8.noarch.rpm 2.1 MB/s | 54 kB 00:00 2023-03-06T13:46:38.477 INFO:teuthology.orchestra.run.smithi202.stdout:(73/131): lttng-ust-2.8.1-11.el8.x86_64.rpm 6.1 MB/s | 259 kB 00:00 2023-03-06T13:46:38.519 INFO:teuthology.orchestra.run.smithi202.stdout:(74/131): socat-1.7.4.1-1.el8.x86_64.rpm 7.6 MB/s | 323 kB 00:00 2023-03-06T13:46:38.545 INFO:teuthology.orchestra.run.smithi202.stdout:(75/131): python3-markupsafe-0.23-19.el8.x86_64 1.5 MB/s | 39 kB 00:00 2023-03-06T13:46:38.648 INFO:teuthology.orchestra.run.smithi086.stdout:(130/131): librados2-18.0.0-2739.g472aaef4.el8. 8.6 MB/s | 3.7 MB 00:00 2023-03-06T13:46:38.679 INFO:teuthology.orchestra.run.smithi202.stdout:(76/131): bison-3.0.4-10.el8.x86_64.rpm 5.0 MB/s | 688 kB 00:00 2023-03-06T13:46:38.723 INFO:teuthology.orchestra.run.smithi086.stdout:(131/131): librbd1-18.0.0-2739.g472aaef4.el8.x8 7.4 MB/s | 3.6 MB 00:00 2023-03-06T13:46:38.726 INFO:teuthology.orchestra.run.smithi086.stdout:-------------------------------------------------------------------------------- 2023-03-06T13:46:38.727 INFO:teuthology.orchestra.run.smithi086.stdout:Total 16 MB/s | 203 MB 00:13 2023-03-06T13:46:38.876 INFO:teuthology.orchestra.run.smithi202.stdout:(77/131): python3-jinja2-2.10.1-3.el8.noarch.rp 2.7 MB/s | 538 kB 00:00 2023-03-06T13:46:38.921 INFO:teuthology.orchestra.run.smithi202.stdout:(78/131): python3-mako-1.0.6-13.el8.noarch.rpm 3.5 MB/s | 157 kB 00:00 2023-03-06T13:46:39.056 INFO:teuthology.orchestra.run.smithi202.stdout:(79/131): python3-scipy-1.0.0-21.module+el8.5.0 19 MB/s | 14 MB 00:00 2023-03-06T13:46:39.071 INFO:teuthology.orchestra.run.smithi202.stdout:(80/131): oniguruma-6.8.2-2.el8.x86_64.rpm 1.2 MB/s | 187 kB 00:00 2023-03-06T13:46:39.105 INFO:teuthology.orchestra.run.smithi202.stdout:(81/131): automake-1.16.1-7.el8.noarch.rpm 14 MB/s | 713 kB 00:00 2023-03-06T13:46:39.147 INFO:teuthology.orchestra.run.smithi202.stdout:(82/131): python3-jsonpatch-1.21-2.el8.noarch.r 637 kB/s | 27 kB 00:00 2023-03-06T13:46:39.189 INFO:teuthology.orchestra.run.smithi202.stdout:(83/131): flex-2.6.1-9.el8.x86_64.rpm 7.5 MB/s | 320 kB 00:00 2023-03-06T13:46:39.223 INFO:teuthology.orchestra.run.smithi202.stdout:(84/131): python3-prettytable-0.7.2-14.el8.noar 1.3 MB/s | 44 kB 00:00 2023-03-06T13:46:39.312 INFO:teuthology.orchestra.run.smithi202.stdout:(85/131): python3-babel-2.5.1-7.el8.noarch.rpm 20 MB/s | 4.8 MB 00:00 2023-03-06T13:46:39.357 INFO:teuthology.orchestra.run.smithi202.stdout:(86/131): thrift-0.13.0-2.el8.x86_64.rpm 1.6 MB/s | 1.7 MB 00:01 2023-03-06T13:46:39.391 INFO:teuthology.orchestra.run.smithi202.stdout:(87/131): python3-werkzeug-0.12.2-4.el8.noarch. 5.7 MB/s | 457 kB 00:00 2023-03-06T13:46:39.432 INFO:teuthology.orchestra.run.smithi202.stdout:(88/131): uuid-1.6.2-43.el8.x86_64.rpm 1.7 MB/s | 64 kB 00:00 2023-03-06T13:46:39.458 INFO:teuthology.orchestra.run.smithi202.stdout:(89/131): python3-numpy-f2py-1.14.3-10.el8.x86_ 2.2 MB/s | 225 kB 00:00 2023-03-06T13:46:39.483 INFO:teuthology.orchestra.run.smithi202.stdout:(90/131): python3-pyasn1-0.3.7-6.el8.noarch.rpm 2.5 MB/s | 126 kB 00:00 2023-03-06T13:46:39.508 INFO:teuthology.orchestra.run.smithi202.stdout:(91/131): python3-jsonpointer-1.10-11.el8.noarc 397 kB/s | 20 kB 00:00 2023-03-06T13:46:39.534 INFO:teuthology.orchestra.run.smithi202.stdout:(92/131): python3-pyOpenSSL-19.0.0-1.el8.noarch 2.0 MB/s | 103 kB 00:00 2023-03-06T13:46:39.555 INFO:teuthology.orchestra.run.smithi086.stdout:Running transaction check 2023-03-06T13:46:39.570 INFO:teuthology.orchestra.run.smithi202.stdout:(93/131): libtool-2.4.6-25.el8.x86_64.rpm 11 MB/s | 709 kB 00:00 2023-03-06T13:46:39.628 INFO:teuthology.orchestra.run.smithi202.stdout:(94/131): python3-numpy-1.14.3-10.el8.x86_64.rp 9.2 MB/s | 3.7 MB 00:00 2023-03-06T13:46:39.653 INFO:teuthology.orchestra.run.smithi202.stdout:(95/131): libpq-13.5-1.el8.x86_64.rpm 2.3 MB/s | 198 kB 00:00 2023-03-06T13:46:39.675 INFO:teuthology.orchestra.run.smithi086.stdout:Transaction check succeeded. 2023-03-06T13:46:39.675 INFO:teuthology.orchestra.run.smithi086.stdout:Running transaction test 2023-03-06T13:46:39.695 INFO:teuthology.orchestra.run.smithi202.stdout:(96/131): jq-1.6-3.el8.x86_64.rpm 4.8 MB/s | 202 kB 00:00 2023-03-06T13:46:39.754 INFO:teuthology.orchestra.run.smithi202.stdout:(97/131): librdkafka-0.11.4-3.el8.x86_64.rpm 6.0 MB/s | 354 kB 00:00 2023-03-06T13:46:39.854 INFO:teuthology.orchestra.run.smithi202.stdout:(98/131): openblas-threads-0.3.15-3.el8.x86_64. 15 MB/s | 4.9 MB 00:00 2023-03-06T13:46:39.929 INFO:teuthology.orchestra.run.smithi202.stdout:(99/131): openblas-0.3.15-3.el8.x86_64.rpm 16 MB/s | 4.7 MB 00:00 2023-03-06T13:46:39.971 INFO:teuthology.orchestra.run.smithi202.stdout:(100/131): postgresql-contrib-10.21-2.module+el 6.8 MB/s | 808 kB 00:00 2023-03-06T13:46:40.013 INFO:teuthology.orchestra.run.smithi202.stdout:(101/131): librabbitmq-0.9.0-3.el8.x86_64.rpm 1.1 MB/s | 47 kB 00:00 2023-03-06T13:46:40.055 INFO:teuthology.orchestra.run.smithi202.stdout:(102/131): postgresql-10.21-2.module+el8.6.0+15 12 MB/s | 1.5 MB 00:00 2023-03-06T13:46:40.080 INFO:teuthology.orchestra.run.smithi202.stdout:(103/131): libselinux-devel-2.9-5.el8.x86_64.rp 2.9 MB/s | 200 kB 00:00 2023-03-06T13:46:40.106 INFO:teuthology.orchestra.run.smithi202.stdout:(104/131): python3-jwt-1.6.1-2.el8.noarch.rpm 849 kB/s | 43 kB 00:00 2023-03-06T13:46:40.131 INFO:teuthology.orchestra.run.smithi202.stdout:(105/131): pcre2-utf32-10.32-2.el8.x86_64.rpm 4.3 MB/s | 220 kB 00:00 2023-03-06T13:46:40.181 INFO:teuthology.orchestra.run.smithi202.stdout:(106/131): keyutils-libs-devel-1.5.10-9.el8.x86 639 kB/s | 48 kB 00:00 2023-03-06T13:46:40.206 INFO:teuthology.orchestra.run.smithi202.stdout:(107/131): libsepol-devel-2.9-3.el8.x86_64.rpm 1.1 MB/s | 87 kB 00:00 2023-03-06T13:46:40.232 INFO:teuthology.orchestra.run.smithi202.stdout:(108/131): python3-requests-oauthlib-1.0.0-1.el 850 kB/s | 43 kB 00:00 2023-03-06T13:46:40.257 INFO:teuthology.orchestra.run.smithi202.stdout:(109/131): python3-pycparser-2.14-14.el8.noarch 2.1 MB/s | 109 kB 00:00 2023-03-06T13:46:40.282 INFO:teuthology.orchestra.run.smithi202.stdout:(110/131): pcre2-utf16-10.32-2.el8.x86_64.rpm 4.4 MB/s | 229 kB 00:00 2023-03-06T13:46:40.316 INFO:teuthology.orchestra.run.smithi202.stdout:(111/131): krb5-devel-1.18.2-14.el8.x86_64.rpm 9.3 MB/s | 560 kB 00:00 2023-03-06T13:46:40.341 INFO:teuthology.orchestra.run.smithi202.stdout:(112/131): libaio-devel-0.3.112-1.el8.x86_64.rp 319 kB/s | 19 kB 00:00 2023-03-06T13:46:40.408 INFO:teuthology.orchestra.run.smithi202.stdout:(113/131): postgresql-server-10.21-2.module+el8 7.7 MB/s | 5.1 MB 00:00 2023-03-06T13:46:40.433 INFO:teuthology.orchestra.run.smithi202.stdout:(114/131): python3-oauthlib-2.1.0-1.el8.noarch. 1.3 MB/s | 155 kB 00:00 2023-03-06T13:46:40.459 INFO:teuthology.orchestra.run.smithi202.stdout:(115/131): libverto-devel-0.3.0-5.el8.x86_64.rp 357 kB/s | 18 kB 00:00 2023-03-06T13:46:40.492 INFO:teuthology.orchestra.run.smithi202.stdout:(116/131): python3-cryptography-3.2.1-5.el8.x86 3.6 MB/s | 559 kB 00:00 2023-03-06T13:46:40.526 INFO:teuthology.orchestra.run.smithi202.stdout:(117/131): pcre2-devel-10.32-2.el8.x86_64.rpm 6.4 MB/s | 605 kB 00:00 2023-03-06T13:46:40.551 INFO:teuthology.orchestra.run.smithi202.stdout:(118/131): python3-cffi-1.11.5-5.el8.x86_64.rpm 2.5 MB/s | 238 kB 00:00 2023-03-06T13:46:40.576 INFO:teuthology.orchestra.run.smithi202.stdout:(119/131): xfsprogs-devel-5.0.0-10.el8.x86_64.r 1.4 MB/s | 72 kB 00:00 2023-03-06T13:46:40.626 INFO:teuthology.orchestra.run.smithi202.stdout:(120/131): fuse-2.9.7-15.el8.x86_64.rpm 1.1 MB/s | 83 kB 00:00 2023-03-06T13:46:40.660 INFO:teuthology.orchestra.run.smithi202.stdout:(121/131): elfutils-libelf-devel-0.186-1.el8.x8 717 kB/s | 60 kB 00:00 2023-03-06T13:46:40.685 INFO:teuthology.orchestra.run.smithi202.stdout:(122/131): libuuid-devel-2.32.1-35.el8.x86_64.r 1.6 MB/s | 98 kB 00:00 2023-03-06T13:46:40.711 INFO:teuthology.orchestra.run.smithi202.stdout:(123/131): zlib-devel-1.2.11-18.el8_5.x86_64.rp 1.1 MB/s | 58 kB 00:00 2023-03-06T13:46:40.736 INFO:teuthology.orchestra.run.smithi202.stdout:(124/131): libcom_err-devel-1.45.6-4.el8.x86_64 766 kB/s | 39 kB 00:00 2023-03-06T13:46:40.770 INFO:teuthology.orchestra.run.smithi202.stdout:(125/131): libgfortran-8.5.0-10.1.el8_6.x86_64. 11 MB/s | 644 kB 00:00 2023-03-06T13:46:40.774 INFO:teuthology.orchestra.run.smithi086.stdout:Transaction test succeeded. 2023-03-06T13:46:40.778 INFO:teuthology.orchestra.run.smithi086.stdout:Running transaction 2023-03-06T13:46:40.795 INFO:teuthology.orchestra.run.smithi202.stdout:(126/131): libquadmath-8.5.0-10.1.el8_6.x86_64. 2.9 MB/s | 171 kB 00:00 2023-03-06T13:46:40.821 INFO:teuthology.orchestra.run.smithi202.stdout:(127/131): NetworkManager-initscripts-updown-1. 2.7 MB/s | 138 kB 00:00 2023-03-06T13:46:40.879 INFO:teuthology.orchestra.run.smithi202.stdout:(128/131): openssl-devel-1.1.1k-7.el8_6.x86_64. 6.0 MB/s | 2.3 MB 00:00 2023-03-06T13:46:40.929 INFO:teuthology.orchestra.run.smithi202.stdout:(129/131): iproute-5.15.0-4.el8_6.1.x86_64.rpm 16 MB/s | 798 kB 00:00 2023-03-06T13:46:41.296 INFO:teuthology.orchestra.run.smithi202.stdout:(130/131): librbd1-18.0.0-2739.g472aaef4.el8.x8 7.5 MB/s | 3.6 MB 00:00 2023-03-06T13:46:41.346 INFO:teuthology.orchestra.run.smithi202.stdout:(131/131): librados2-18.0.0-2739.g472aaef4.el8. 6.6 MB/s | 3.7 MB 00:00 2023-03-06T13:46:41.349 INFO:teuthology.orchestra.run.smithi202.stdout:-------------------------------------------------------------------------------- 2023-03-06T13:46:41.349 INFO:teuthology.orchestra.run.smithi202.stdout:Total 13 MB/s | 203 MB 00:15 2023-03-06T13:46:42.187 INFO:teuthology.orchestra.run.smithi202.stdout:Running transaction check 2023-03-06T13:46:42.307 INFO:teuthology.orchestra.run.smithi202.stdout:Transaction check succeeded. 2023-03-06T13:46:42.307 INFO:teuthology.orchestra.run.smithi202.stdout:Running transaction test 2023-03-06T13:46:43.410 INFO:teuthology.orchestra.run.smithi202.stdout:Transaction test succeeded. 2023-03-06T13:46:43.414 INFO:teuthology.orchestra.run.smithi202.stdout:Running transaction 2023-03-06T13:46:45.600 INFO:teuthology.orchestra.run.smithi086.stdout: Preparing : 1/1 2023-03-06T13:46:45.765 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/134 2023-03-06T13:46:45.937 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/134 2023-03-06T13:46:46.165 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 3/134 2023-03-06T13:46:46.334 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 4/134 2023-03-06T13:46:46.443 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 4/134 2023-03-06T13:46:46.642 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 5/134 2023-03-06T13:46:47.026 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 5/134 2023-03-06T13:46:47.259 INFO:teuthology.orchestra.run.smithi086.stdout: Upgrading : librados2-2:18.0.0-2739.g472aaef4.el8.x86_64 6/134 2023-03-06T13:46:47.640 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: librados2-2:18.0.0-2739.g472aaef4.el8.x86_64 6/134 2023-03-06T13:46:47.826 INFO:teuthology.orchestra.run.smithi086.stdout: Upgrading : librbd1-2:18.0.0-2739.g472aaef4.el8.x86_64 7/134 2023-03-06T13:46:47.948 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: librbd1-2:18.0.0-2739.g472aaef4.el8.x86_64 7/134 2023-03-06T13:46:48.125 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : libcephfs2-2:18.0.0-2739.g472aaef4.el8.x86_64 8/134 2023-03-06T13:46:48.237 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: libcephfs2-2:18.0.0-2739.g472aaef4.el8.x86_64 8/134 2023-03-06T13:46:48.442 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-rados-2:18.0.0-2739.g472aaef4.el8.x86_64 9/134 2023-03-06T13:46:48.624 INFO:teuthology.orchestra.run.smithi202.stdout: Preparing : 1/1 2023-03-06T13:46:48.670 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : libpq-13.5-1.el8.x86_64 10/134 2023-03-06T13:46:48.794 INFO:teuthology.orchestra.run.smithi202.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/134 2023-03-06T13:46:48.870 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/134 2023-03-06T13:46:48.978 INFO:teuthology.orchestra.run.smithi202.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/134 2023-03-06T13:46:49.195 INFO:teuthology.orchestra.run.smithi202.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 3/134 2023-03-06T13:46:49.281 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/134 2023-03-06T13:46:49.388 INFO:teuthology.orchestra.run.smithi202.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 4/134 2023-03-06T13:46:49.510 INFO:teuthology.orchestra.run.smithi202.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 4/134 2023-03-06T13:46:49.529 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : postgresql-10.21-2.module+el8.6.0+15342+53518fac 13/134 2023-03-06T13:46:49.675 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : libcephsqlite-2:18.0.0-2739.g472aaef4.el8.x86_64 14/134 2023-03-06T13:46:49.747 INFO:teuthology.orchestra.run.smithi202.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 5/134 2023-03-06T13:46:49.777 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: libcephsqlite-2:18.0.0-2739.g472aaef4.el8.x86_64 14/134 2023-03-06T13:46:49.950 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : libradosstriper1-2:18.0.0-2739.g472aaef4.el8.x86 15/134 2023-03-06T13:46:50.024 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: libradosstriper1-2:18.0.0-2739.g472aaef4.el8.x86 15/134 2023-03-06T13:46:50.141 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : libquadmath-8.5.0-10.1.el8_6.x86_64 16/134 2023-03-06T13:46:50.153 INFO:teuthology.orchestra.run.smithi202.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 5/134 2023-03-06T13:46:50.277 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: libquadmath-8.5.0-10.1.el8_6.x86_64 16/134 2023-03-06T13:46:50.413 INFO:teuthology.orchestra.run.smithi202.stdout: Upgrading : librados2-2:18.0.0-2739.g472aaef4.el8.x86_64 6/134 2023-03-06T13:46:50.434 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : libgfortran-8.5.0-10.1.el8_6.x86_64 17/134 2023-03-06T13:46:50.813 INFO:teuthology.orchestra.run.smithi202.stdout: Running scriptlet: librados2-2:18.0.0-2739.g472aaef4.el8.x86_64 6/134 2023-03-06T13:46:51.046 INFO:teuthology.orchestra.run.smithi202.stdout: Upgrading : librbd1-2:18.0.0-2739.g472aaef4.el8.x86_64 7/134 2023-03-06T13:46:51.047 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: libgfortran-8.5.0-10.1.el8_6.x86_64 17/134 2023-03-06T13:46:51.153 INFO:teuthology.orchestra.run.smithi202.stdout: Running scriptlet: librbd1-2:18.0.0-2739.g472aaef4.el8.x86_64 7/134 2023-03-06T13:46:51.200 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : openblas-threads-0.3.15-3.el8.x86_64 18/134 2023-03-06T13:46:51.321 INFO:teuthology.orchestra.run.smithi202.stdout: Installing : libcephfs2-2:18.0.0-2739.g472aaef4.el8.x86_64 8/134 2023-03-06T13:46:51.401 INFO:teuthology.orchestra.run.smithi202.stdout: Running scriptlet: libcephfs2-2:18.0.0-2739.g472aaef4.el8.x86_64 8/134 2023-03-06T13:46:51.646 INFO:teuthology.orchestra.run.smithi202.stdout: Installing : python3-rados-2:18.0.0-2739.g472aaef4.el8.x86_64 9/134 2023-03-06T13:46:51.797 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: openblas-threads-0.3.15-3.el8.x86_64 18/134 2023-03-06T13:46:51.891 INFO:teuthology.orchestra.run.smithi202.stdout: Installing : libpq-13.5-1.el8.x86_64 10/134 2023-03-06T13:46:51.966 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : openblas-0.3.15-3.el8.x86_64 19/134 2023-03-06T13:46:52.099 INFO:teuthology.orchestra.run.smithi202.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/134 2023-03-06T13:46:52.501 INFO:teuthology.orchestra.run.smithi202.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/134 2023-03-06T13:46:52.667 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: openblas-0.3.15-3.el8.x86_64 19/134 2023-03-06T13:46:52.733 INFO:teuthology.orchestra.run.smithi202.stdout: Installing : postgresql-10.21-2.module+el8.6.0+15342+53518fac 13/134 2023-03-06T13:46:52.927 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 20/134 2023-03-06T13:46:52.929 INFO:teuthology.orchestra.run.smithi202.stdout: Installing : libcephsqlite-2:18.0.0-2739.g472aaef4.el8.x86_64 14/134 2023-03-06T13:46:53.024 INFO:teuthology.orchestra.run.smithi202.stdout: Running scriptlet: libcephsqlite-2:18.0.0-2739.g472aaef4.el8.x86_64 14/134 2023-03-06T13:46:53.150 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 21/134 2023-03-06T13:46:53.213 INFO:teuthology.orchestra.run.smithi202.stdout: Installing : libradosstriper1-2:18.0.0-2739.g472aaef4.el8.x86 15/134 2023-03-06T13:46:53.273 INFO:teuthology.orchestra.run.smithi202.stdout: Running scriptlet: libradosstriper1-2:18.0.0-2739.g472aaef4.el8.x86 15/134 2023-03-06T13:46:53.361 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 22/134 2023-03-06T13:46:53.395 INFO:teuthology.orchestra.run.smithi202.stdout: Installing : libquadmath-8.5.0-10.1.el8_6.x86_64 16/134 2023-03-06T13:46:53.530 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 23/134 2023-03-06T13:46:53.537 INFO:teuthology.orchestra.run.smithi202.stdout: Running scriptlet: libquadmath-8.5.0-10.1.el8_6.x86_64 16/134 2023-03-06T13:46:53.712 INFO:teuthology.orchestra.run.smithi202.stdout: Installing : libgfortran-8.5.0-10.1.el8_6.x86_64 17/134 2023-03-06T13:46:53.746 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 24/134 2023-03-06T13:46:53.976 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/134 2023-03-06T13:46:54.148 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-ceph-common-2:18.0.0-2739.g472aaef4.el8. 26/134 2023-03-06T13:46:54.284 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-ceph-argparse-2:18.0.0-2739.g472aaef4.el 27/134 2023-03-06T13:46:54.328 INFO:teuthology.orchestra.run.smithi202.stdout: Running scriptlet: libgfortran-8.5.0-10.1.el8_6.x86_64 17/134 2023-03-06T13:46:54.471 INFO:teuthology.orchestra.run.smithi202.stdout: Installing : openblas-threads-0.3.15-3.el8.x86_64 18/134 2023-03-06T13:46:55.086 INFO:teuthology.orchestra.run.smithi202.stdout: Running scriptlet: openblas-threads-0.3.15-3.el8.x86_64 18/134 2023-03-06T13:46:55.176 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-cephfs-2:18.0.0-2739.g472aaef4.el8.x86_6 28/134 2023-03-06T13:46:55.321 INFO:teuthology.orchestra.run.smithi202.stdout: Installing : openblas-0.3.15-3.el8.x86_64 19/134 2023-03-06T13:46:55.488 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 29/134 2023-03-06T13:46:55.972 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 30/134 2023-03-06T13:46:56.064 INFO:teuthology.orchestra.run.smithi202.stdout: Running scriptlet: openblas-0.3.15-3.el8.x86_64 19/134 2023-03-06T13:46:56.232 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 31/134 2023-03-06T13:46:56.355 INFO:teuthology.orchestra.run.smithi202.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 20/134 2023-03-06T13:46:56.441 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 32/134 2023-03-06T13:46:56.580 INFO:teuthology.orchestra.run.smithi202.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 21/134 2023-03-06T13:46:56.849 INFO:teuthology.orchestra.run.smithi202.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 22/134 2023-03-06T13:46:57.034 INFO:teuthology.orchestra.run.smithi202.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 23/134 2023-03-06T13:46:57.253 INFO:teuthology.orchestra.run.smithi202.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 24/134 2023-03-06T13:46:57.472 INFO:teuthology.orchestra.run.smithi202.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/134 2023-03-06T13:46:57.668 INFO:teuthology.orchestra.run.smithi202.stdout: Installing : python3-ceph-common-2:18.0.0-2739.g472aaef4.el8. 26/134 2023-03-06T13:46:57.805 INFO:teuthology.orchestra.run.smithi202.stdout: Installing : python3-ceph-argparse-2:18.0.0-2739.g472aaef4.el 27/134 2023-03-06T13:46:58.192 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 32/134 2023-03-06T13:46:58.484 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 33/134 2023-03-06T13:46:58.685 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-rsa-4.8-1.el8.noarch 34/134 2023-03-06T13:46:58.711 INFO:teuthology.orchestra.run.smithi202.stdout: Installing : python3-cephfs-2:18.0.0-2739.g472aaef4.el8.x86_6 28/134 2023-03-06T13:46:58.867 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 35/134 2023-03-06T13:46:59.047 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-rbd-2:18.0.0-2739.g472aaef4.el8.x86_64 36/134 2023-03-06T13:46:59.068 INFO:teuthology.orchestra.run.smithi202.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 29/134 2023-03-06T13:46:59.236 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : librados-devel-2:18.0.0-2739.g472aaef4.el8.x86_6 37/134 2023-03-06T13:46:59.339 INFO:teuthology.orchestra.run.smithi202.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 30/134 2023-03-06T13:46:59.414 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 38/134 2023-03-06T13:46:59.600 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : libuuid-devel-2.32.1-35.el8.x86_64 39/134 2023-03-06T13:46:59.601 INFO:teuthology.orchestra.run.smithi202.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 31/134 2023-03-06T13:46:59.776 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : fuse-2.9.7-15.el8.x86_64 40/134 2023-03-06T13:46:59.820 INFO:teuthology.orchestra.run.smithi202.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 32/134 2023-03-06T13:46:59.927 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 41/134 2023-03-06T13:47:00.138 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 42/134 2023-03-06T13:47:00.363 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 43/134 2023-03-06T13:47:00.737 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 44/134 2023-03-06T13:47:01.027 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 45/134 2023-03-06T13:47:01.226 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 46/134 2023-03-06T13:47:01.464 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 47/134 2023-03-06T13:47:01.585 INFO:teuthology.orchestra.run.smithi202.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 32/134 2023-03-06T13:47:01.653 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 48/134 2023-03-06T13:47:01.888 INFO:teuthology.orchestra.run.smithi202.stdout: Installing : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 33/134 2023-03-06T13:47:01.966 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 49/134 2023-03-06T13:47:02.131 INFO:teuthology.orchestra.run.smithi202.stdout: Installing : python3-rsa-4.8-1.el8.noarch 34/134 2023-03-06T13:47:02.189 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 50/134 2023-03-06T13:47:02.305 INFO:teuthology.orchestra.run.smithi202.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 35/134 2023-03-06T13:47:02.374 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 51/134 2023-03-06T13:47:02.492 INFO:teuthology.orchestra.run.smithi202.stdout: Installing : python3-rbd-2:18.0.0-2739.g472aaef4.el8.x86_64 36/134 2023-03-06T13:47:02.628 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 52/134 2023-03-06T13:47:02.648 INFO:teuthology.orchestra.run.smithi202.stdout: Installing : librados-devel-2:18.0.0-2739.g472aaef4.el8.x86_6 37/134 2023-03-06T13:47:02.803 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 53/134 2023-03-06T13:47:02.836 INFO:teuthology.orchestra.run.smithi202.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 38/134 2023-03-06T13:47:02.968 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 54/134 2023-03-06T13:47:03.004 INFO:teuthology.orchestra.run.smithi202.stdout: Installing : libuuid-devel-2.32.1-35.el8.x86_64 39/134 2023-03-06T13:47:03.188 INFO:teuthology.orchestra.run.smithi202.stdout: Installing : fuse-2.9.7-15.el8.x86_64 40/134 2023-03-06T13:47:03.278 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 55/134 2023-03-06T13:47:03.348 INFO:teuthology.orchestra.run.smithi202.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 41/134 2023-03-06T13:47:03.527 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 56/134 2023-03-06T13:47:03.535 INFO:teuthology.orchestra.run.smithi202.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 42/134 2023-03-06T13:47:03.761 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 57/134 2023-03-06T13:47:03.775 INFO:teuthology.orchestra.run.smithi202.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 43/134 2023-03-06T13:47:03.996 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : krb5-devel-1.18.2-14.el8.x86_64 58/134 2023-03-06T13:47:04.140 INFO:teuthology.orchestra.run.smithi202.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 44/134 2023-03-06T13:47:04.172 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 59/134 2023-03-06T13:47:04.333 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 60/134 2023-03-06T13:47:04.422 INFO:teuthology.orchestra.run.smithi202.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 45/134 2023-03-06T13:47:04.514 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : uuid-1.6.2-43.el8.x86_64 61/134 2023-03-06T13:47:04.611 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 61/134 2023-03-06T13:47:04.662 INFO:teuthology.orchestra.run.smithi202.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 46/134 2023-03-06T13:47:04.826 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 62/134 2023-03-06T13:47:04.866 INFO:teuthology.orchestra.run.smithi202.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 47/134 2023-03-06T13:47:05.018 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : automake-1.16.1-7.el8.noarch 63/134 2023-03-06T13:47:05.107 INFO:teuthology.orchestra.run.smithi202.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 48/134 2023-03-06T13:47:05.181 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 64/134 2023-03-06T13:47:05.247 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 64/134 2023-03-06T13:47:05.420 INFO:teuthology.orchestra.run.smithi202.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 49/134 2023-03-06T13:47:05.460 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : jq-1.6-3.el8.x86_64 65/134 2023-03-06T13:47:05.623 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 66/134 2023-03-06T13:47:05.677 INFO:teuthology.orchestra.run.smithi202.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 50/134 2023-03-06T13:47:05.813 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 67/134 2023-03-06T13:47:05.920 INFO:teuthology.orchestra.run.smithi202.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 51/134 2023-03-06T13:47:06.000 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 68/134 2023-03-06T13:47:06.142 INFO:teuthology.orchestra.run.smithi202.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 52/134 2023-03-06T13:47:06.277 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 69/134 2023-03-06T13:47:06.334 INFO:teuthology.orchestra.run.smithi202.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 53/134 2023-03-06T13:47:06.496 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-waitress-1.2.1-2.el8.1.noarch 70/134 2023-03-06T13:47:06.506 INFO:teuthology.orchestra.run.smithi202.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 54/134 2023-03-06T13:47:06.668 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 71/134 2023-03-06T13:47:06.816 INFO:teuthology.orchestra.run.smithi202.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 55/134 2023-03-06T13:47:06.849 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 72/134 2023-03-06T13:47:07.047 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 73/134 2023-03-06T13:47:07.066 INFO:teuthology.orchestra.run.smithi202.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 56/134 2023-03-06T13:47:07.243 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 74/134 2023-03-06T13:47:07.332 INFO:teuthology.orchestra.run.smithi202.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 57/134 2023-03-06T13:47:07.432 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 75/134 2023-03-06T13:47:07.584 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 76/134 2023-03-06T13:47:07.584 INFO:teuthology.orchestra.run.smithi202.stdout: Installing : krb5-devel-1.18.2-14.el8.x86_64 58/134 2023-03-06T13:47:07.720 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 77/134 2023-03-06T13:47:07.784 INFO:teuthology.orchestra.run.smithi202.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 59/134 2023-03-06T13:47:07.944 INFO:teuthology.orchestra.run.smithi202.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 60/134 2023-03-06T13:47:07.962 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 78/134 2023-03-06T13:47:08.168 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 79/134 2023-03-06T13:47:08.185 INFO:teuthology.orchestra.run.smithi202.stdout: Installing : uuid-1.6.2-43.el8.x86_64 61/134 2023-03-06T13:47:08.258 INFO:teuthology.orchestra.run.smithi202.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 61/134 2023-03-06T13:47:08.371 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 80/134 2023-03-06T13:47:08.482 INFO:teuthology.orchestra.run.smithi202.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 62/134 2023-03-06T13:47:08.629 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-portend-2.6-1.el8.noarch 81/134 2023-03-06T13:47:08.705 INFO:teuthology.orchestra.run.smithi202.stdout: Installing : automake-1.16.1-7.el8.noarch 63/134 2023-03-06T13:47:08.851 INFO:teuthology.orchestra.run.smithi202.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 64/134 2023-03-06T13:47:08.872 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 82/134 2023-03-06T13:47:08.927 INFO:teuthology.orchestra.run.smithi202.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 64/134 2023-03-06T13:47:09.080 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 83/134 2023-03-06T13:47:09.173 INFO:teuthology.orchestra.run.smithi202.stdout: Installing : jq-1.6-3.el8.x86_64 65/134 2023-03-06T13:47:09.321 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 84/134 2023-03-06T13:47:09.353 INFO:teuthology.orchestra.run.smithi202.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 66/134 2023-03-06T13:47:09.559 INFO:teuthology.orchestra.run.smithi202.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 67/134 2023-03-06T13:47:09.763 INFO:teuthology.orchestra.run.smithi202.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 68/134 2023-03-06T13:47:10.073 INFO:teuthology.orchestra.run.smithi202.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 69/134 2023-03-06T13:47:10.325 INFO:teuthology.orchestra.run.smithi202.stdout: Installing : python3-waitress-1.2.1-2.el8.1.noarch 70/134 2023-03-06T13:47:10.390 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 85/134 2023-03-06T13:47:10.506 INFO:teuthology.orchestra.run.smithi202.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 71/134 2023-03-06T13:47:10.650 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 86/134 2023-03-06T13:47:10.705 INFO:teuthology.orchestra.run.smithi202.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 72/134 2023-03-06T13:47:10.905 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 87/134 2023-03-06T13:47:10.912 INFO:teuthology.orchestra.run.smithi202.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 73/134 2023-03-06T13:47:11.098 INFO:teuthology.orchestra.run.smithi202.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 74/134 2023-03-06T13:47:11.222 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 88/134 2023-03-06T13:47:11.322 INFO:teuthology.orchestra.run.smithi202.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 75/134 2023-03-06T13:47:11.500 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 89/134 2023-03-06T13:47:11.504 INFO:teuthology.orchestra.run.smithi202.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 76/134 2023-03-06T13:47:11.691 INFO:teuthology.orchestra.run.smithi202.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 77/134 2023-03-06T13:47:11.728 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 90/134 2023-03-06T13:47:11.890 INFO:teuthology.orchestra.run.smithi202.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 78/134 2023-03-06T13:47:12.147 INFO:teuthology.orchestra.run.smithi202.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 79/134 2023-03-06T13:47:12.348 INFO:teuthology.orchestra.run.smithi202.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 80/134 2023-03-06T13:47:12.488 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 91/134 2023-03-06T13:47:12.622 INFO:teuthology.orchestra.run.smithi202.stdout: Installing : python3-portend-2.6-1.el8.noarch 81/134 2023-03-06T13:47:12.649 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : librgw2-2:18.0.0-2739.g472aaef4.el8.x86_64 92/134 2023-03-06T13:47:12.723 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: librgw2-2:18.0.0-2739.g472aaef4.el8.x86_64 92/134 2023-03-06T13:47:12.858 INFO:teuthology.orchestra.run.smithi202.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 82/134 2023-03-06T13:47:12.905 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-rgw-2:18.0.0-2739.g472aaef4.el8.x86_64 93/134 2023-03-06T13:47:13.083 INFO:teuthology.orchestra.run.smithi202.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 83/134 2023-03-06T13:47:13.310 INFO:teuthology.orchestra.run.smithi202.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 84/134 2023-03-06T13:47:14.410 INFO:teuthology.orchestra.run.smithi202.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 85/134 2023-03-06T13:47:14.671 INFO:teuthology.orchestra.run.smithi202.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 86/134 2023-03-06T13:47:14.925 INFO:teuthology.orchestra.run.smithi202.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 87/134 2023-03-06T13:47:15.251 INFO:teuthology.orchestra.run.smithi202.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 88/134 2023-03-06T13:47:15.555 INFO:teuthology.orchestra.run.smithi202.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 89/134 2023-03-06T13:47:15.759 INFO:teuthology.orchestra.run.smithi202.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 90/134 2023-03-06T13:47:16.414 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: ceph-common-2:18.0.0-2739.g472aaef4.el8.x86_64 94/134 2023-03-06T13:47:16.593 INFO:teuthology.orchestra.run.smithi202.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 91/134 2023-03-06T13:47:16.767 INFO:teuthology.orchestra.run.smithi202.stdout: Installing : librgw2-2:18.0.0-2739.g472aaef4.el8.x86_64 92/134 2023-03-06T13:47:16.803 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-common-2:18.0.0-2739.g472aaef4.el8.x86_64 94/134 2023-03-06T13:47:16.873 INFO:teuthology.orchestra.run.smithi202.stdout: Running scriptlet: librgw2-2:18.0.0-2739.g472aaef4.el8.x86_64 92/134 2023-03-06T13:47:17.034 INFO:teuthology.orchestra.run.smithi202.stdout: Installing : python3-rgw-2:18.0.0-2739.g472aaef4.el8.x86_64 93/134 2023-03-06T13:47:17.378 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: ceph-common-2:18.0.0-2739.g472aaef4.el8.x86_64 94/134 2023-03-06T13:47:17.731 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-base-2:18.0.0-2739.g472aaef4.el8.x86_64 95/134 2023-03-06T13:47:17.815 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: ceph-base-2:18.0.0-2739.g472aaef4.el8.x86_64 95/134 2023-03-06T13:47:17.921 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-selinux-2:18.0.0-2739.g472aaef4.el8.x86_64 96/134 2023-03-06T13:47:20.672 INFO:teuthology.orchestra.run.smithi202.stdout: Running scriptlet: ceph-common-2:18.0.0-2739.g472aaef4.el8.x86_64 94/134 2023-03-06T13:47:20.909 INFO:teuthology.orchestra.run.smithi202.stdout: Installing : ceph-common-2:18.0.0-2739.g472aaef4.el8.x86_64 94/134 2023-03-06T13:47:21.601 INFO:teuthology.orchestra.run.smithi202.stdout: Running scriptlet: ceph-common-2:18.0.0-2739.g472aaef4.el8.x86_64 94/134 2023-03-06T13:47:22.202 INFO:teuthology.orchestra.run.smithi202.stdout: Installing : ceph-base-2:18.0.0-2739.g472aaef4.el8.x86_64 95/134 2023-03-06T13:47:22.287 INFO:teuthology.orchestra.run.smithi202.stdout: Running scriptlet: ceph-base-2:18.0.0-2739.g472aaef4.el8.x86_64 95/134 2023-03-06T13:47:22.441 INFO:teuthology.orchestra.run.smithi202.stdout: Installing : ceph-selinux-2:18.0.0-2739.g472aaef4.el8.x86_64 96/134 2023-03-06T13:47:36.544 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: ceph-selinux-2:18.0.0-2739.g472aaef4.el8.x86_64 96/134 2023-03-06T13:47:36.544 INFO:teuthology.orchestra.run.smithi086.stdout:skipping the directory /sys 2023-03-06T13:47:36.545 INFO:teuthology.orchestra.run.smithi086.stdout:skipping the directory /proc 2023-03-06T13:47:36.545 INFO:teuthology.orchestra.run.smithi086.stdout:skipping the directory /dev 2023-03-06T13:47:36.545 INFO:teuthology.orchestra.run.smithi086.stdout:skipping the directory /run 2023-03-06T13:47:36.545 INFO:teuthology.orchestra.run.smithi086.stdout:skipping the directory /mnt 2023-03-06T13:47:36.545 INFO:teuthology.orchestra.run.smithi086.stdout:skipping the directory /var/tmp 2023-03-06T13:47:36.546 INFO:teuthology.orchestra.run.smithi086.stdout:skipping the directory /home 2023-03-06T13:47:36.546 INFO:teuthology.orchestra.run.smithi086.stdout:skipping the directory /tmp 2023-03-06T13:47:36.547 INFO:teuthology.orchestra.run.smithi086.stdout:skipping the directory /dev 2023-03-06T13:47:36.547 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-03-06T13:47:36.911 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-volume-2:18.0.0-2739.g472aaef4.el8.noarch 97/134 2023-03-06T13:47:38.491 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: ceph-volume-2:18.0.0-2739.g472aaef4.el8.noarch 97/134 2023-03-06T13:47:38.670 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-osd-2:18.0.0-2739.g472aaef4.el8.x86_64 98/134 2023-03-06T13:47:38.887 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: ceph-osd-2:18.0.0-2739.g472aaef4.el8.x86_64 98/134 2023-03-06T13:47:39.060 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-mds-2:18.0.0-2739.g472aaef4.el8.x86_64 99/134 2023-03-06T13:47:39.510 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: ceph-mds-2:18.0.0-2739.g472aaef4.el8.x86_64 99/134 2023-03-06T13:47:39.694 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-mon-2:18.0.0-2739.g472aaef4.el8.x86_64 100/134 2023-03-06T13:47:39.711 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: ceph-mon-2:18.0.0-2739.g472aaef4.el8.x86_64 100/134 2023-03-06T13:47:41.270 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: cephadm-2:18.0.0-2739.g472aaef4.el8.noarch 101/134 2023-03-06T13:47:41.331 INFO:teuthology.orchestra.run.smithi202.stdout: Running scriptlet: ceph-selinux-2:18.0.0-2739.g472aaef4.el8.x86_64 96/134 2023-03-06T13:47:41.331 INFO:teuthology.orchestra.run.smithi202.stdout:skipping the directory /sys 2023-03-06T13:47:41.332 INFO:teuthology.orchestra.run.smithi202.stdout:skipping the directory /proc 2023-03-06T13:47:41.332 INFO:teuthology.orchestra.run.smithi202.stdout:skipping the directory /dev 2023-03-06T13:47:41.332 INFO:teuthology.orchestra.run.smithi202.stdout:skipping the directory /run 2023-03-06T13:47:41.332 INFO:teuthology.orchestra.run.smithi202.stdout:skipping the directory /mnt 2023-03-06T13:47:41.332 INFO:teuthology.orchestra.run.smithi202.stdout:skipping the directory /var/tmp 2023-03-06T13:47:41.332 INFO:teuthology.orchestra.run.smithi202.stdout:skipping the directory /home 2023-03-06T13:47:41.332 INFO:teuthology.orchestra.run.smithi202.stdout:skipping the directory /tmp 2023-03-06T13:47:41.333 INFO:teuthology.orchestra.run.smithi202.stdout:skipping the directory /dev 2023-03-06T13:47:41.333 INFO:teuthology.orchestra.run.smithi202.stdout: 2023-03-06T13:47:41.464 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : cephadm-2:18.0.0-2739.g472aaef4.el8.noarch 101/134 2023-03-06T13:47:41.582 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-2739.g472aaef4.e 102/134 2023-03-06T13:47:41.697 INFO:teuthology.orchestra.run.smithi202.stdout: Installing : ceph-volume-2:18.0.0-2739.g472aaef4.el8.noarch 97/134 2023-03-06T13:47:41.748 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-2739.g472aaef4. 103/134 2023-03-06T13:47:41.943 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-2739.g472aaef4.el8.noa 104/134 2023-03-06T13:47:42.158 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-2739.g472aaef4.el8.noa 104/134 2023-03-06T13:47:42.460 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-2739.g472aaef4.el8.n 105/134 2023-03-06T13:47:43.274 INFO:teuthology.orchestra.run.smithi202.stdout: Running scriptlet: ceph-volume-2:18.0.0-2739.g472aaef4.el8.noarch 97/134 2023-03-06T13:47:43.417 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-2739.g472aaef4.el8.n 105/134 2023-03-06T13:47:43.440 INFO:teuthology.orchestra.run.smithi202.stdout: Installing : ceph-osd-2:18.0.0-2739.g472aaef4.el8.x86_64 98/134 2023-03-06T13:47:43.576 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-2739.g472 106/134 2023-03-06T13:47:43.658 INFO:teuthology.orchestra.run.smithi202.stdout: Running scriptlet: ceph-osd-2:18.0.0-2739.g472aaef4.el8.x86_64 98/134 2023-03-06T13:47:43.667 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-2739.g472 106/134 2023-03-06T13:47:43.864 INFO:teuthology.orchestra.run.smithi202.stdout: Installing : ceph-mds-2:18.0.0-2739.g472aaef4.el8.x86_64 99/134 2023-03-06T13:47:44.013 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-2739.g472aaef4.el 107/134 2023-03-06T13:47:44.194 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-mgr-2:18.0.0-2739.g472aaef4.el8.x86_64 108/134 2023-03-06T13:47:44.229 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: ceph-mgr-2:18.0.0-2739.g472aaef4.el8.x86_64 108/134 2023-03-06T13:47:44.313 INFO:teuthology.orchestra.run.smithi202.stdout: Running scriptlet: ceph-mds-2:18.0.0-2739.g472aaef4.el8.x86_64 99/134 2023-03-06T13:47:44.418 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-mgr-rook-2:18.0.0-2739.g472aaef4.el8.noarch 109/134 2023-03-06T13:47:44.429 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-2739.g472aaef4.el8.noarch 109/134 2023-03-06T13:47:44.521 INFO:teuthology.orchestra.run.smithi202.stdout: Installing : ceph-mon-2:18.0.0-2739.g472aaef4.el8.x86_64 100/134 2023-03-06T13:47:44.539 INFO:teuthology.orchestra.run.smithi202.stdout: Running scriptlet: ceph-mon-2:18.0.0-2739.g472aaef4.el8.x86_64 100/134 2023-03-06T13:47:45.686 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-2:18.0.0-2739.g472aaef4.el8.x86_64 110/134 2023-03-06T13:47:45.908 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-radosgw-2:18.0.0-2739.g472aaef4.el8.x86_64 111/134 2023-03-06T13:47:45.942 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-2739.g472aaef4.el8.x86_64 111/134 2023-03-06T13:47:46.084 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-2739.g472aa 112/134 2023-03-06T13:47:46.126 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-2739.g472aa 112/134 2023-03-06T13:47:46.169 INFO:teuthology.orchestra.run.smithi202.stdout: Running scriptlet: cephadm-2:18.0.0-2739.g472aaef4.el8.noarch 101/134 2023-03-06T13:47:46.276 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : cephfs-mirror-2:18.0.0-2739.g472aaef4.el8.x86_64 113/134 2023-03-06T13:47:46.376 INFO:teuthology.orchestra.run.smithi202.stdout: Installing : cephadm-2:18.0.0-2739.g472aaef4.el8.noarch 101/134 2023-03-06T13:47:46.510 INFO:teuthology.orchestra.run.smithi202.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-2739.g472aaef4.e 102/134 2023-03-06T13:47:46.621 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-2739.g472aaef4.el8.x86_64 113/134 2023-03-06T13:47:46.713 INFO:teuthology.orchestra.run.smithi202.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-2739.g472aaef4. 103/134 2023-03-06T13:47:46.784 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : rbd-mirror-2:18.0.0-2739.g472aaef4.el8.x86_64 114/134 2023-03-06T13:47:46.929 INFO:teuthology.orchestra.run.smithi202.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-2739.g472aaef4.el8.noa 104/134 2023-03-06T13:47:47.143 INFO:teuthology.orchestra.run.smithi202.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-2739.g472aaef4.el8.noa 104/134 2023-03-06T13:47:47.397 INFO:teuthology.orchestra.run.smithi202.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-2739.g472aaef4.el8.n 105/134 2023-03-06T13:47:48.359 INFO:teuthology.orchestra.run.smithi202.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-2739.g472aaef4.el8.n 105/134 2023-03-06T13:47:48.545 INFO:teuthology.orchestra.run.smithi202.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-2739.g472 106/134 2023-03-06T13:47:48.634 INFO:teuthology.orchestra.run.smithi202.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-2739.g472 106/134 2023-03-06T13:47:49.042 INFO:teuthology.orchestra.run.smithi202.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-2739.g472aaef4.el 107/134 2023-03-06T13:47:49.239 INFO:teuthology.orchestra.run.smithi202.stdout: Installing : ceph-mgr-2:18.0.0-2739.g472aaef4.el8.x86_64 108/134 2023-03-06T13:47:49.274 INFO:teuthology.orchestra.run.smithi202.stdout: Running scriptlet: ceph-mgr-2:18.0.0-2739.g472aaef4.el8.x86_64 108/134 2023-03-06T13:47:49.478 INFO:teuthology.orchestra.run.smithi202.stdout: Installing : ceph-mgr-rook-2:18.0.0-2739.g472aaef4.el8.noarch 109/134 2023-03-06T13:47:49.493 INFO:teuthology.orchestra.run.smithi202.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-2739.g472aaef4.el8.noarch 109/134 2023-03-06T13:47:50.757 INFO:teuthology.orchestra.run.smithi202.stdout: Installing : ceph-2:18.0.0-2739.g472aaef4.el8.x86_64 110/134 2023-03-06T13:47:50.969 INFO:teuthology.orchestra.run.smithi202.stdout: Installing : ceph-radosgw-2:18.0.0-2739.g472aaef4.el8.x86_64 111/134 2023-03-06T13:47:51.002 INFO:teuthology.orchestra.run.smithi202.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-2739.g472aaef4.el8.x86_64 111/134 2023-03-06T13:47:51.195 INFO:teuthology.orchestra.run.smithi202.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-2739.g472aa 112/134 2023-03-06T13:47:51.201 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: rbd-mirror-2:18.0.0-2739.g472aaef4.el8.x86_64 114/134 2023-03-06T13:47:51.237 INFO:teuthology.orchestra.run.smithi202.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-2739.g472aa 112/134 2023-03-06T13:47:51.387 INFO:teuthology.orchestra.run.smithi202.stdout: Installing : cephfs-mirror-2:18.0.0-2739.g472aaef4.el8.x86_64 113/134 2023-03-06T13:47:51.477 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-test-2:18.0.0-2739.g472aaef4.el8.x86_64 115/134 2023-03-06T13:47:51.625 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : libtool-2.4.6-25.el8.x86_64 116/134 2023-03-06T13:47:51.733 INFO:teuthology.orchestra.run.smithi202.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-2739.g472aaef4.el8.x86_64 113/134 2023-03-06T13:47:51.818 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 116/134 2023-03-06T13:47:51.895 INFO:teuthology.orchestra.run.smithi202.stdout: Installing : rbd-mirror-2:18.0.0-2739.g472aaef4.el8.x86_64 114/134 2023-03-06T13:47:52.716 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 117/134 2023-03-06T13:47:53.006 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : openssl-devel-1:1.1.1k-7.el8_6.x86_64 118/134 2023-03-06T13:47:53.204 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-fuse-2:18.0.0-2739.g472aaef4.el8.x86_64 119/134 2023-03-06T13:47:53.396 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : xfsprogs-devel-5.0.0-10.el8.x86_64 120/134 2023-03-06T13:47:53.562 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : libcephfs-devel-2:18.0.0-2739.g472aaef4.el8.x86_ 121/134 2023-03-06T13:47:53.726 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-03-06T13:47:55.801 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-03-06T13:47:56.041 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-03-06T13:47:56.059 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-03-06T13:47:56.292 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : cephfs-top-2:18.0.0-2739.g472aaef4.el8.noarch 124/134 2023-03-06T13:47:56.330 INFO:teuthology.orchestra.run.smithi202.stdout: Running scriptlet: rbd-mirror-2:18.0.0-2739.g472aaef4.el8.x86_64 114/134 2023-03-06T13:47:56.549 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : rbd-fuse-2:18.0.0-2739.g472aaef4.el8.x86_64 125/134 2023-03-06T13:47:56.618 INFO:teuthology.orchestra.run.smithi202.stdout: Installing : ceph-test-2:18.0.0-2739.g472aaef4.el8.x86_64 115/134 2023-03-06T13:47:56.802 INFO:teuthology.orchestra.run.smithi202.stdout: Installing : libtool-2.4.6-25.el8.x86_64 116/134 2023-03-06T13:47:56.844 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : rbd-nbd-2:18.0.0-2739.g472aaef4.el8.x86_64 126/134 2023-03-06T13:47:56.994 INFO:teuthology.orchestra.run.smithi202.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 116/134 2023-03-06T13:47:57.151 INFO:teuthology.orchestra.run.smithi086.stdout: Upgrading : iproute-5.15.0-4.el8_6.1.x86_64 127/134 2023-03-06T13:47:57.299 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-03-06T13:47:57.308 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-03-06T13:47:57.496 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 129/134 2023-03-06T13:47:57.682 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : flex-2.6.1-9.el8.x86_64 130/134 2023-03-06T13:47:57.767 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 130/134 2023-03-06T13:47:57.882 INFO:teuthology.orchestra.run.smithi202.stdout: Installing : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 117/134 2023-03-06T13:47:57.974 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : bison-3.0.4-10.el8.x86_64 131/134 2023-03-06T13:47:57.987 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 131/134 2023-03-06T13:47:57.987 INFO:teuthology.orchestra.run.smithi086.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-03-06T13:47:58.202 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-03-06T13:47:58.203 INFO:teuthology.orchestra.run.smithi086.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 133/134 2023-03-06T13:47:58.225 INFO:teuthology.orchestra.run.smithi202.stdout: Installing : openssl-devel-1:1.1.1k-7.el8_6.x86_64 118/134 2023-03-06T13:47:58.411 INFO:teuthology.orchestra.run.smithi202.stdout: Installing : ceph-fuse-2:18.0.0-2739.g472aaef4.el8.x86_64 119/134 2023-03-06T13:47:58.448 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 133/134 2023-03-06T13:47:58.631 INFO:teuthology.orchestra.run.smithi202.stdout: Installing : xfsprogs-devel-5.0.0-10.el8.x86_64 120/134 2023-03-06T13:47:58.656 INFO:teuthology.orchestra.run.smithi086.stdout: Cleanup : iproute-5.15.0-4.el8.x86_64 134/134 2023-03-06T13:47:58.823 INFO:teuthology.orchestra.run.smithi202.stdout: Installing : libcephfs-devel-2:18.0.0-2739.g472aaef4.el8.x86_ 121/134 2023-03-06T13:47:58.951 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: iproute-5.15.0-4.el8.x86_64 134/134 2023-03-06T13:47:58.952 INFO:teuthology.orchestra.run.smithi086.stdout:[/usr/lib/tmpfiles.d/journal-nocow.conf:26] Failed to resolve specifier: uninitialized /etc detected, skipping 2023-03-06T13:47:58.952 INFO:teuthology.orchestra.run.smithi086.stdout:All rules containing unresolvable specifiers will be skipped. 2023-03-06T13:47:58.952 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-03-06T13:47:59.003 INFO:teuthology.orchestra.run.smithi202.stdout: Installing : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-03-06T13:47:59.167 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-2:18.0.0-2739.g472aaef4.el8.x86_64 1/134 2023-03-06T13:47:59.167 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-base-2:18.0.0-2739.g472aaef4.el8.x86_64 2/134 2023-03-06T13:47:59.167 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-common-2:18.0.0-2739.g472aaef4.el8.x86_64 3/134 2023-03-06T13:47:59.167 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-fuse-2:18.0.0-2739.g472aaef4.el8.x86_64 4/134 2023-03-06T13:47:59.167 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-2739.g472aa 5/134 2023-03-06T13:47:59.167 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-mds-2:18.0.0-2739.g472aaef4.el8.x86_64 6/134 2023-03-06T13:47:59.168 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-mgr-2:18.0.0-2739.g472aaef4.el8.x86_64 7/134 2023-03-06T13:47:59.168 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-mon-2:18.0.0-2739.g472aaef4.el8.x86_64 8/134 2023-03-06T13:47:59.168 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-osd-2:18.0.0-2739.g472aaef4.el8.x86_64 9/134 2023-03-06T13:47:59.168 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-radosgw-2:18.0.0-2739.g472aaef4.el8.x86_64 10/134 2023-03-06T13:47:59.168 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-selinux-2:18.0.0-2739.g472aaef4.el8.x86_64 11/134 2023-03-06T13:47:59.168 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-test-2:18.0.0-2739.g472aaef4.el8.x86_64 12/134 2023-03-06T13:47:59.168 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : cephfs-mirror-2:18.0.0-2739.g472aaef4.el8.x86_64 13/134 2023-03-06T13:47:59.169 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : libcephfs-devel-2:18.0.0-2739.g472aaef4.el8.x86_ 14/134 2023-03-06T13:47:59.169 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : libcephfs2-2:18.0.0-2739.g472aaef4.el8.x86_64 15/134 2023-03-06T13:47:59.169 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : libcephsqlite-2:18.0.0-2739.g472aaef4.el8.x86_64 16/134 2023-03-06T13:47:59.169 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : librados-devel-2:18.0.0-2739.g472aaef4.el8.x86_6 17/134 2023-03-06T13:47:59.169 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : libradosstriper1-2:18.0.0-2739.g472aaef4.el8.x86 18/134 2023-03-06T13:47:59.169 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : librgw2-2:18.0.0-2739.g472aaef4.el8.x86_64 19/134 2023-03-06T13:47:59.170 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-ceph-argparse-2:18.0.0-2739.g472aaef4.el 20/134 2023-03-06T13:47:59.170 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-ceph-common-2:18.0.0-2739.g472aaef4.el8. 21/134 2023-03-06T13:47:59.170 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-cephfs-2:18.0.0-2739.g472aaef4.el8.x86_6 22/134 2023-03-06T13:47:59.170 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-rados-2:18.0.0-2739.g472aaef4.el8.x86_64 23/134 2023-03-06T13:47:59.170 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-rbd-2:18.0.0-2739.g472aaef4.el8.x86_64 24/134 2023-03-06T13:47:59.180 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-rgw-2:18.0.0-2739.g472aaef4.el8.x86_64 25/134 2023-03-06T13:47:59.180 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : rbd-fuse-2:18.0.0-2739.g472aaef4.el8.x86_64 26/134 2023-03-06T13:47:59.180 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : rbd-mirror-2:18.0.0-2739.g472aaef4.el8.x86_64 27/134 2023-03-06T13:47:59.181 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : rbd-nbd-2:18.0.0-2739.g472aaef4.el8.x86_64 28/134 2023-03-06T13:47:59.181 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-2739.g472aaef4. 29/134 2023-03-06T13:47:59.181 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-2739.g472aaef4.el8.noa 30/134 2023-03-06T13:47:59.181 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-2739.g472aaef4.el8.n 31/134 2023-03-06T13:47:59.181 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-2739.g472 32/134 2023-03-06T13:47:59.182 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-2739.g472aaef4.el 33/134 2023-03-06T13:47:59.182 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-mgr-rook-2:18.0.0-2739.g472aaef4.el8.noarch 34/134 2023-03-06T13:47:59.182 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-2739.g472aaef4.e 35/134 2023-03-06T13:47:59.182 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-volume-2:18.0.0-2739.g472aaef4.el8.noarch 36/134 2023-03-06T13:47:59.182 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : cephadm-2:18.0.0-2739.g472aaef4.el8.noarch 37/134 2023-03-06T13:47:59.182 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : cephfs-top-2:18.0.0-2739.g472aaef4.el8.noarch 38/134 2023-03-06T13:47:59.182 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/134 2023-03-06T13:47:59.183 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/134 2023-03-06T13:47:59.183 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/134 2023-03-06T13:47:59.183 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/134 2023-03-06T13:47:59.183 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/134 2023-03-06T13:47:59.183 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/134 2023-03-06T13:47:59.183 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/134 2023-03-06T13:47:59.183 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/134 2023-03-06T13:47:59.183 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/134 2023-03-06T13:47:59.184 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/134 2023-03-06T13:47:59.184 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/134 2023-03-06T13:47:59.184 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/134 2023-03-06T13:47:59.184 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/134 2023-03-06T13:47:59.184 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/134 2023-03-06T13:47:59.184 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/134 2023-03-06T13:47:59.184 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/134 2023-03-06T13:47:59.185 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/134 2023-03-06T13:47:59.185 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/134 2023-03-06T13:47:59.185 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/134 2023-03-06T13:47:59.185 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/134 2023-03-06T13:47:59.185 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/134 2023-03-06T13:47:59.185 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-rsa-4.8-1.el8.noarch 60/134 2023-03-06T13:47:59.185 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/134 2023-03-06T13:47:59.186 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/134 2023-03-06T13:47:59.186 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/134 2023-03-06T13:47:59.186 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/134 2023-03-06T13:47:59.186 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-waitress-1.2.1-2.el8.1.noarch 65/134 2023-03-06T13:47:59.187 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/134 2023-03-06T13:47:59.187 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/134 2023-03-06T13:47:59.187 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/134 2023-03-06T13:47:59.187 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/134 2023-03-06T13:47:59.187 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/134 2023-03-06T13:47:59.187 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/134 2023-03-06T13:47:59.187 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 72/134 2023-03-06T13:47:59.187 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 73/134 2023-03-06T13:47:59.188 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 74/134 2023-03-06T13:47:59.188 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 75/134 2023-03-06T13:47:59.188 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 76/134 2023-03-06T13:47:59.188 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 77/134 2023-03-06T13:47:59.188 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : bison-3.0.4-10.el8.x86_64 78/134 2023-03-06T13:47:59.188 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 79/134 2023-03-06T13:47:59.188 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 80/134 2023-03-06T13:47:59.189 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 81/134 2023-03-06T13:47:59.189 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : automake-1.16.1-7.el8.noarch 82/134 2023-03-06T13:47:59.189 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 83/134 2023-03-06T13:47:59.189 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 84/134 2023-03-06T13:47:59.189 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : flex-2.6.1-9.el8.x86_64 85/134 2023-03-06T13:47:59.189 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 86/134 2023-03-06T13:47:59.189 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 87/134 2023-03-06T13:47:59.189 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 88/134 2023-03-06T13:47:59.190 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 89/134 2023-03-06T13:47:59.190 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 90/134 2023-03-06T13:47:59.190 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 91/134 2023-03-06T13:47:59.190 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 92/134 2023-03-06T13:47:59.190 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 93/134 2023-03-06T13:47:59.190 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 94/134 2023-03-06T13:47:59.190 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : openblas-threads-0.3.15-3.el8.x86_64 95/134 2023-03-06T13:47:59.190 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : libpq-13.5-1.el8.x86_64 96/134 2023-03-06T13:47:59.191 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : openblas-0.3.15-3.el8.x86_64 97/134 2023-03-06T13:47:59.191 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : jq-1.6-3.el8.x86_64 98/134 2023-03-06T13:47:59.191 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 99/134 2023-03-06T13:47:59.191 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : postgresql-server-10.21-2.module+el8.6.0+15342+5 100/134 2023-03-06T13:47:59.191 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 101/134 2023-03-06T13:47:59.191 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : postgresql-10.21-2.module+el8.6.0+15342+53518fac 102/134 2023-03-06T13:47:59.191 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 103/134 2023-03-06T13:47:59.191 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 104/134 2023-03-06T13:47:59.192 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 105/134 2023-03-06T13:47:59.192 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 106/134 2023-03-06T13:47:59.192 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 107/134 2023-03-06T13:47:59.192 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 108/134 2023-03-06T13:47:59.192 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 109/134 2023-03-06T13:47:59.192 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 110/134 2023-03-06T13:47:59.192 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 111/134 2023-03-06T13:47:59.193 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : krb5-devel-1.18.2-14.el8.x86_64 112/134 2023-03-06T13:47:59.193 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 113/134 2023-03-06T13:47:59.193 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 114/134 2023-03-06T13:47:59.193 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 115/134 2023-03-06T13:47:59.193 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 116/134 2023-03-06T13:47:59.193 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 117/134 2023-03-06T13:47:59.194 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 118/134 2023-03-06T13:47:59.194 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : openssl-devel-1:1.1.1k-7.el8_6.x86_64 119/134 2023-03-06T13:47:59.194 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : xfsprogs-devel-5.0.0-10.el8.x86_64 120/134 2023-03-06T13:47:59.194 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : fuse-2.9.7-15.el8.x86_64 121/134 2023-03-06T13:47:59.194 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-03-06T13:47:59.194 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : libuuid-devel-2.32.1-35.el8.x86_64 123/134 2023-03-06T13:47:59.194 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 124/134 2023-03-06T13:47:59.194 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 125/134 2023-03-06T13:47:59.195 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : libgfortran-8.5.0-10.1.el8_6.x86_64 126/134 2023-03-06T13:47:59.195 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : libquadmath-8.5.0-10.1.el8_6.x86_64 127/134 2023-03-06T13:47:59.195 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-03-06T13:47:59.195 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : librados2-2:18.0.0-2739.g472aaef4.el8.x86_64 129/134 2023-03-06T13:47:59.195 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 130/134 2023-03-06T13:47:59.195 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : librbd1-2:18.0.0-2739.g472aaef4.el8.x86_64 131/134 2023-03-06T13:47:59.195 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-03-06T13:47:59.195 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : iproute-5.15.0-4.el8_6.1.x86_64 133/134 2023-03-06T13:48:01.175 INFO:teuthology.orchestra.run.smithi202.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-03-06T13:48:01.402 INFO:teuthology.orchestra.run.smithi202.stdout: Installing : postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-03-06T13:48:01.420 INFO:teuthology.orchestra.run.smithi202.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-03-06T13:48:01.635 INFO:teuthology.orchestra.run.smithi202.stdout: Installing : cephfs-top-2:18.0.0-2739.g472aaef4.el8.noarch 124/134 2023-03-06T13:48:01.861 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : iproute-5.15.0-4.el8.x86_64 134/134 2023-03-06T13:48:01.861 INFO:teuthology.orchestra.run.smithi086.stdout:Last metadata expiration check: 0:01:47 ago on Mon 06 Mar 2023 01:46:14 PM UTC. 2023-03-06T13:48:01.892 INFO:teuthology.orchestra.run.smithi202.stdout: Installing : rbd-fuse-2:18.0.0-2739.g472aaef4.el8.x86_64 125/134 2023-03-06T13:48:02.196 INFO:teuthology.orchestra.run.smithi202.stdout: Installing : rbd-nbd-2:18.0.0-2739.g472aaef4.el8.x86_64 126/134 2023-03-06T13:48:02.520 INFO:teuthology.orchestra.run.smithi202.stdout: Upgrading : iproute-5.15.0-4.el8_6.1.x86_64 127/134 2023-03-06T13:48:02.651 INFO:teuthology.orchestra.run.smithi202.stdout: Installing : NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-03-06T13:48:02.660 INFO:teuthology.orchestra.run.smithi202.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-03-06T13:48:02.867 INFO:teuthology.orchestra.run.smithi202.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 129/134 2023-03-06T13:48:03.043 INFO:teuthology.orchestra.run.smithi202.stdout: Installing : flex-2.6.1-9.el8.x86_64 130/134 2023-03-06T13:48:03.125 INFO:teuthology.orchestra.run.smithi202.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 130/134 2023-03-06T13:48:03.343 INFO:teuthology.orchestra.run.smithi202.stdout: Installing : bison-3.0.4-10.el8.x86_64 131/134 2023-03-06T13:48:03.356 INFO:teuthology.orchestra.run.smithi202.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 131/134 2023-03-06T13:48:03.356 INFO:teuthology.orchestra.run.smithi202.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-03-06T13:48:03.579 INFO:teuthology.orchestra.run.smithi202.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-03-06T13:48:03.580 INFO:teuthology.orchestra.run.smithi202.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 133/134 2023-03-06T13:48:03.866 INFO:teuthology.orchestra.run.smithi202.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 133/134 2023-03-06T13:48:04.075 INFO:teuthology.orchestra.run.smithi202.stdout: Cleanup : iproute-5.15.0-4.el8.x86_64 134/134 2023-03-06T13:48:04.393 INFO:teuthology.orchestra.run.smithi202.stdout: Running scriptlet: iproute-5.15.0-4.el8.x86_64 134/134 2023-03-06T13:48:04.394 INFO:teuthology.orchestra.run.smithi202.stdout:[/usr/lib/tmpfiles.d/journal-nocow.conf:26] Failed to resolve specifier: uninitialized /etc detected, skipping 2023-03-06T13:48:04.394 INFO:teuthology.orchestra.run.smithi202.stdout:All rules containing unresolvable specifiers will be skipped. 2023-03-06T13:48:04.394 INFO:teuthology.orchestra.run.smithi202.stdout: 2023-03-06T13:48:04.419 INFO:teuthology.orchestra.run.smithi086.stdout:Installed products updated. 2023-03-06T13:48:04.619 INFO:teuthology.orchestra.run.smithi202.stdout: Verifying : ceph-2:18.0.0-2739.g472aaef4.el8.x86_64 1/134 2023-03-06T13:48:04.619 INFO:teuthology.orchestra.run.smithi202.stdout: Verifying : ceph-base-2:18.0.0-2739.g472aaef4.el8.x86_64 2/134 2023-03-06T13:48:04.620 INFO:teuthology.orchestra.run.smithi202.stdout: Verifying : ceph-common-2:18.0.0-2739.g472aaef4.el8.x86_64 3/134 2023-03-06T13:48:04.620 INFO:teuthology.orchestra.run.smithi202.stdout: Verifying : ceph-fuse-2:18.0.0-2739.g472aaef4.el8.x86_64 4/134 2023-03-06T13:48:04.620 INFO:teuthology.orchestra.run.smithi202.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-2739.g472aa 5/134 2023-03-06T13:48:04.620 INFO:teuthology.orchestra.run.smithi202.stdout: Verifying : ceph-mds-2:18.0.0-2739.g472aaef4.el8.x86_64 6/134 2023-03-06T13:48:04.620 INFO:teuthology.orchestra.run.smithi202.stdout: Verifying : ceph-mgr-2:18.0.0-2739.g472aaef4.el8.x86_64 7/134 2023-03-06T13:48:04.620 INFO:teuthology.orchestra.run.smithi202.stdout: Verifying : ceph-mon-2:18.0.0-2739.g472aaef4.el8.x86_64 8/134 2023-03-06T13:48:04.621 INFO:teuthology.orchestra.run.smithi202.stdout: Verifying : ceph-osd-2:18.0.0-2739.g472aaef4.el8.x86_64 9/134 2023-03-06T13:48:04.621 INFO:teuthology.orchestra.run.smithi202.stdout: Verifying : ceph-radosgw-2:18.0.0-2739.g472aaef4.el8.x86_64 10/134 2023-03-06T13:48:04.621 INFO:teuthology.orchestra.run.smithi202.stdout: Verifying : ceph-selinux-2:18.0.0-2739.g472aaef4.el8.x86_64 11/134 2023-03-06T13:48:04.622 INFO:teuthology.orchestra.run.smithi202.stdout: Verifying : ceph-test-2:18.0.0-2739.g472aaef4.el8.x86_64 12/134 2023-03-06T13:48:04.622 INFO:teuthology.orchestra.run.smithi202.stdout: Verifying : cephfs-mirror-2:18.0.0-2739.g472aaef4.el8.x86_64 13/134 2023-03-06T13:48:04.622 INFO:teuthology.orchestra.run.smithi202.stdout: Verifying : libcephfs-devel-2:18.0.0-2739.g472aaef4.el8.x86_ 14/134 2023-03-06T13:48:04.622 INFO:teuthology.orchestra.run.smithi202.stdout: Verifying : libcephfs2-2:18.0.0-2739.g472aaef4.el8.x86_64 15/134 2023-03-06T13:48:04.622 INFO:teuthology.orchestra.run.smithi202.stdout: Verifying : libcephsqlite-2:18.0.0-2739.g472aaef4.el8.x86_64 16/134 2023-03-06T13:48:04.622 INFO:teuthology.orchestra.run.smithi202.stdout: Verifying : librados-devel-2:18.0.0-2739.g472aaef4.el8.x86_6 17/134 2023-03-06T13:48:04.622 INFO:teuthology.orchestra.run.smithi202.stdout: Verifying : libradosstriper1-2:18.0.0-2739.g472aaef4.el8.x86 18/134 2023-03-06T13:48:04.623 INFO:teuthology.orchestra.run.smithi202.stdout: Verifying : librgw2-2:18.0.0-2739.g472aaef4.el8.x86_64 19/134 2023-03-06T13:48:04.623 INFO:teuthology.orchestra.run.smithi202.stdout: Verifying : python3-ceph-argparse-2:18.0.0-2739.g472aaef4.el 20/134 2023-03-06T13:48:04.623 INFO:teuthology.orchestra.run.smithi202.stdout: Verifying : python3-ceph-common-2:18.0.0-2739.g472aaef4.el8. 21/134 2023-03-06T13:48:04.623 INFO:teuthology.orchestra.run.smithi202.stdout: Verifying : python3-cephfs-2:18.0.0-2739.g472aaef4.el8.x86_6 22/134 2023-03-06T13:48:04.623 INFO:teuthology.orchestra.run.smithi202.stdout: Verifying : python3-rados-2:18.0.0-2739.g472aaef4.el8.x86_64 23/134 2023-03-06T13:48:04.623 INFO:teuthology.orchestra.run.smithi202.stdout: Verifying : python3-rbd-2:18.0.0-2739.g472aaef4.el8.x86_64 24/134 2023-03-06T13:48:04.623 INFO:teuthology.orchestra.run.smithi202.stdout: Verifying : python3-rgw-2:18.0.0-2739.g472aaef4.el8.x86_64 25/134 2023-03-06T13:48:04.624 INFO:teuthology.orchestra.run.smithi202.stdout: Verifying : rbd-fuse-2:18.0.0-2739.g472aaef4.el8.x86_64 26/134 2023-03-06T13:48:04.624 INFO:teuthology.orchestra.run.smithi202.stdout: Verifying : rbd-mirror-2:18.0.0-2739.g472aaef4.el8.x86_64 27/134 2023-03-06T13:48:04.624 INFO:teuthology.orchestra.run.smithi202.stdout: Verifying : rbd-nbd-2:18.0.0-2739.g472aaef4.el8.x86_64 28/134 2023-03-06T13:48:04.624 INFO:teuthology.orchestra.run.smithi202.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-2739.g472aaef4. 29/134 2023-03-06T13:48:04.624 INFO:teuthology.orchestra.run.smithi202.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-2739.g472aaef4.el8.noa 30/134 2023-03-06T13:48:04.624 INFO:teuthology.orchestra.run.smithi202.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-2739.g472aaef4.el8.n 31/134 2023-03-06T13:48:04.624 INFO:teuthology.orchestra.run.smithi202.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-2739.g472 32/134 2023-03-06T13:48:04.624 INFO:teuthology.orchestra.run.smithi202.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-2739.g472aaef4.el 33/134 2023-03-06T13:48:04.625 INFO:teuthology.orchestra.run.smithi202.stdout: Verifying : ceph-mgr-rook-2:18.0.0-2739.g472aaef4.el8.noarch 34/134 2023-03-06T13:48:04.625 INFO:teuthology.orchestra.run.smithi202.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-2739.g472aaef4.e 35/134 2023-03-06T13:48:04.625 INFO:teuthology.orchestra.run.smithi202.stdout: Verifying : ceph-volume-2:18.0.0-2739.g472aaef4.el8.noarch 36/134 2023-03-06T13:48:04.625 INFO:teuthology.orchestra.run.smithi202.stdout: Verifying : cephadm-2:18.0.0-2739.g472aaef4.el8.noarch 37/134 2023-03-06T13:48:04.625 INFO:teuthology.orchestra.run.smithi202.stdout: Verifying : cephfs-top-2:18.0.0-2739.g472aaef4.el8.noarch 38/134 2023-03-06T13:48:04.625 INFO:teuthology.orchestra.run.smithi202.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/134 2023-03-06T13:48:04.625 INFO:teuthology.orchestra.run.smithi202.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/134 2023-03-06T13:48:04.626 INFO:teuthology.orchestra.run.smithi202.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/134 2023-03-06T13:48:04.626 INFO:teuthology.orchestra.run.smithi202.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/134 2023-03-06T13:48:04.626 INFO:teuthology.orchestra.run.smithi202.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/134 2023-03-06T13:48:04.626 INFO:teuthology.orchestra.run.smithi202.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/134 2023-03-06T13:48:04.626 INFO:teuthology.orchestra.run.smithi202.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/134 2023-03-06T13:48:04.626 INFO:teuthology.orchestra.run.smithi202.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/134 2023-03-06T13:48:04.626 INFO:teuthology.orchestra.run.smithi202.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/134 2023-03-06T13:48:04.627 INFO:teuthology.orchestra.run.smithi202.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/134 2023-03-06T13:48:04.627 INFO:teuthology.orchestra.run.smithi202.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/134 2023-03-06T13:48:04.627 INFO:teuthology.orchestra.run.smithi202.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/134 2023-03-06T13:48:04.627 INFO:teuthology.orchestra.run.smithi202.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/134 2023-03-06T13:48:04.627 INFO:teuthology.orchestra.run.smithi202.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/134 2023-03-06T13:48:04.627 INFO:teuthology.orchestra.run.smithi202.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/134 2023-03-06T13:48:04.627 INFO:teuthology.orchestra.run.smithi202.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/134 2023-03-06T13:48:04.628 INFO:teuthology.orchestra.run.smithi202.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/134 2023-03-06T13:48:04.628 INFO:teuthology.orchestra.run.smithi202.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/134 2023-03-06T13:48:04.628 INFO:teuthology.orchestra.run.smithi202.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/134 2023-03-06T13:48:04.628 INFO:teuthology.orchestra.run.smithi202.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/134 2023-03-06T13:48:04.628 INFO:teuthology.orchestra.run.smithi202.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/134 2023-03-06T13:48:04.628 INFO:teuthology.orchestra.run.smithi202.stdout: Verifying : python3-rsa-4.8-1.el8.noarch 60/134 2023-03-06T13:48:04.628 INFO:teuthology.orchestra.run.smithi202.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/134 2023-03-06T13:48:04.628 INFO:teuthology.orchestra.run.smithi202.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/134 2023-03-06T13:48:04.629 INFO:teuthology.orchestra.run.smithi202.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/134 2023-03-06T13:48:04.629 INFO:teuthology.orchestra.run.smithi202.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/134 2023-03-06T13:48:04.629 INFO:teuthology.orchestra.run.smithi202.stdout: Verifying : python3-waitress-1.2.1-2.el8.1.noarch 65/134 2023-03-06T13:48:04.629 INFO:teuthology.orchestra.run.smithi202.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/134 2023-03-06T13:48:04.629 INFO:teuthology.orchestra.run.smithi202.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/134 2023-03-06T13:48:04.629 INFO:teuthology.orchestra.run.smithi202.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/134 2023-03-06T13:48:04.630 INFO:teuthology.orchestra.run.smithi202.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/134 2023-03-06T13:48:04.630 INFO:teuthology.orchestra.run.smithi202.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/134 2023-03-06T13:48:04.630 INFO:teuthology.orchestra.run.smithi202.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/134 2023-03-06T13:48:04.630 INFO:teuthology.orchestra.run.smithi202.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 72/134 2023-03-06T13:48:04.630 INFO:teuthology.orchestra.run.smithi202.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 73/134 2023-03-06T13:48:04.630 INFO:teuthology.orchestra.run.smithi202.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 74/134 2023-03-06T13:48:04.630 INFO:teuthology.orchestra.run.smithi202.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 75/134 2023-03-06T13:48:04.631 INFO:teuthology.orchestra.run.smithi202.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 76/134 2023-03-06T13:48:04.631 INFO:teuthology.orchestra.run.smithi202.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 77/134 2023-03-06T13:48:04.631 INFO:teuthology.orchestra.run.smithi202.stdout: Verifying : bison-3.0.4-10.el8.x86_64 78/134 2023-03-06T13:48:04.632 INFO:teuthology.orchestra.run.smithi202.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 79/134 2023-03-06T13:48:04.632 INFO:teuthology.orchestra.run.smithi202.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 80/134 2023-03-06T13:48:04.632 INFO:teuthology.orchestra.run.smithi202.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 81/134 2023-03-06T13:48:04.632 INFO:teuthology.orchestra.run.smithi202.stdout: Verifying : automake-1.16.1-7.el8.noarch 82/134 2023-03-06T13:48:04.632 INFO:teuthology.orchestra.run.smithi202.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 83/134 2023-03-06T13:48:04.632 INFO:teuthology.orchestra.run.smithi202.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 84/134 2023-03-06T13:48:04.632 INFO:teuthology.orchestra.run.smithi202.stdout: Verifying : flex-2.6.1-9.el8.x86_64 85/134 2023-03-06T13:48:04.632 INFO:teuthology.orchestra.run.smithi202.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 86/134 2023-03-06T13:48:04.633 INFO:teuthology.orchestra.run.smithi202.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 87/134 2023-03-06T13:48:04.633 INFO:teuthology.orchestra.run.smithi202.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 88/134 2023-03-06T13:48:04.633 INFO:teuthology.orchestra.run.smithi202.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 89/134 2023-03-06T13:48:04.633 INFO:teuthology.orchestra.run.smithi202.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 90/134 2023-03-06T13:48:04.633 INFO:teuthology.orchestra.run.smithi202.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 91/134 2023-03-06T13:48:04.633 INFO:teuthology.orchestra.run.smithi202.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 92/134 2023-03-06T13:48:04.633 INFO:teuthology.orchestra.run.smithi202.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 93/134 2023-03-06T13:48:04.634 INFO:teuthology.orchestra.run.smithi202.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 94/134 2023-03-06T13:48:04.634 INFO:teuthology.orchestra.run.smithi202.stdout: Verifying : openblas-threads-0.3.15-3.el8.x86_64 95/134 2023-03-06T13:48:04.634 INFO:teuthology.orchestra.run.smithi202.stdout: Verifying : libpq-13.5-1.el8.x86_64 96/134 2023-03-06T13:48:04.634 INFO:teuthology.orchestra.run.smithi202.stdout: Verifying : openblas-0.3.15-3.el8.x86_64 97/134 2023-03-06T13:48:04.634 INFO:teuthology.orchestra.run.smithi202.stdout: Verifying : jq-1.6-3.el8.x86_64 98/134 2023-03-06T13:48:04.634 INFO:teuthology.orchestra.run.smithi202.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 99/134 2023-03-06T13:48:04.634 INFO:teuthology.orchestra.run.smithi202.stdout: Verifying : postgresql-server-10.21-2.module+el8.6.0+15342+5 100/134 2023-03-06T13:48:04.635 INFO:teuthology.orchestra.run.smithi202.stdout: Verifying : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 101/134 2023-03-06T13:48:04.635 INFO:teuthology.orchestra.run.smithi202.stdout: Verifying : postgresql-10.21-2.module+el8.6.0+15342+53518fac 102/134 2023-03-06T13:48:04.635 INFO:teuthology.orchestra.run.smithi202.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 103/134 2023-03-06T13:48:04.635 INFO:teuthology.orchestra.run.smithi202.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 104/134 2023-03-06T13:48:04.635 INFO:teuthology.orchestra.run.smithi202.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 105/134 2023-03-06T13:48:04.635 INFO:teuthology.orchestra.run.smithi202.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 106/134 2023-03-06T13:48:04.635 INFO:teuthology.orchestra.run.smithi202.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 107/134 2023-03-06T13:48:04.636 INFO:teuthology.orchestra.run.smithi202.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 108/134 2023-03-06T13:48:04.636 INFO:teuthology.orchestra.run.smithi202.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 109/134 2023-03-06T13:48:04.636 INFO:teuthology.orchestra.run.smithi202.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 110/134 2023-03-06T13:48:04.637 INFO:teuthology.orchestra.run.smithi202.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 111/134 2023-03-06T13:48:04.637 INFO:teuthology.orchestra.run.smithi202.stdout: Verifying : krb5-devel-1.18.2-14.el8.x86_64 112/134 2023-03-06T13:48:04.637 INFO:teuthology.orchestra.run.smithi202.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 113/134 2023-03-06T13:48:04.637 INFO:teuthology.orchestra.run.smithi202.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 114/134 2023-03-06T13:48:04.638 INFO:teuthology.orchestra.run.smithi202.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 115/134 2023-03-06T13:48:04.638 INFO:teuthology.orchestra.run.smithi202.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 116/134 2023-03-06T13:48:04.638 INFO:teuthology.orchestra.run.smithi202.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 117/134 2023-03-06T13:48:04.638 INFO:teuthology.orchestra.run.smithi202.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 118/134 2023-03-06T13:48:04.639 INFO:teuthology.orchestra.run.smithi202.stdout: Verifying : openssl-devel-1:1.1.1k-7.el8_6.x86_64 119/134 2023-03-06T13:48:04.639 INFO:teuthology.orchestra.run.smithi202.stdout: Verifying : xfsprogs-devel-5.0.0-10.el8.x86_64 120/134 2023-03-06T13:48:04.639 INFO:teuthology.orchestra.run.smithi202.stdout: Verifying : fuse-2.9.7-15.el8.x86_64 121/134 2023-03-06T13:48:04.640 INFO:teuthology.orchestra.run.smithi202.stdout: Verifying : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-03-06T13:48:04.640 INFO:teuthology.orchestra.run.smithi202.stdout: Verifying : libuuid-devel-2.32.1-35.el8.x86_64 123/134 2023-03-06T13:48:04.640 INFO:teuthology.orchestra.run.smithi202.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 124/134 2023-03-06T13:48:04.640 INFO:teuthology.orchestra.run.smithi202.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 125/134 2023-03-06T13:48:04.640 INFO:teuthology.orchestra.run.smithi202.stdout: Verifying : libgfortran-8.5.0-10.1.el8_6.x86_64 126/134 2023-03-06T13:48:04.641 INFO:teuthology.orchestra.run.smithi202.stdout: Verifying : libquadmath-8.5.0-10.1.el8_6.x86_64 127/134 2023-03-06T13:48:04.641 INFO:teuthology.orchestra.run.smithi202.stdout: Verifying : NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-03-06T13:48:04.641 INFO:teuthology.orchestra.run.smithi202.stdout: Verifying : librados2-2:18.0.0-2739.g472aaef4.el8.x86_64 129/134 2023-03-06T13:48:04.641 INFO:teuthology.orchestra.run.smithi202.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 130/134 2023-03-06T13:48:04.642 INFO:teuthology.orchestra.run.smithi202.stdout: Verifying : librbd1-2:18.0.0-2739.g472aaef4.el8.x86_64 131/134 2023-03-06T13:48:04.642 INFO:teuthology.orchestra.run.smithi202.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-03-06T13:48:04.642 INFO:teuthology.orchestra.run.smithi202.stdout: Verifying : iproute-5.15.0-4.el8_6.1.x86_64 133/134 2023-03-06T13:48:04.643 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-03-06T13:48:04.643 INFO:teuthology.orchestra.run.smithi086.stdout:Upgraded: 2023-03-06T13:48:04.643 INFO:teuthology.orchestra.run.smithi086.stdout: iproute-5.15.0-4.el8_6.1.x86_64 2023-03-06T13:48:04.644 INFO:teuthology.orchestra.run.smithi086.stdout: librados2-2:18.0.0-2739.g472aaef4.el8.x86_64 2023-03-06T13:48:04.644 INFO:teuthology.orchestra.run.smithi086.stdout: librbd1-2:18.0.0-2739.g472aaef4.el8.x86_64 2023-03-06T13:48:04.644 INFO:teuthology.orchestra.run.smithi086.stdout:Installed: 2023-03-06T13:48:04.644 INFO:teuthology.orchestra.run.smithi086.stdout: NetworkManager-initscripts-updown-1:1.36.0-9.el8_6.noarch 2023-03-06T13:48:04.644 INFO:teuthology.orchestra.run.smithi086.stdout: automake-1.16.1-7.el8.noarch 2023-03-06T13:48:04.645 INFO:teuthology.orchestra.run.smithi086.stdout: bison-3.0.4-10.el8.x86_64 2023-03-06T13:48:04.645 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-2:18.0.0-2739.g472aaef4.el8.x86_64 2023-03-06T13:48:04.645 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-base-2:18.0.0-2739.g472aaef4.el8.x86_64 2023-03-06T13:48:04.645 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-common-2:18.0.0-2739.g472aaef4.el8.x86_64 2023-03-06T13:48:04.646 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-fuse-2:18.0.0-2739.g472aaef4.el8.x86_64 2023-03-06T13:48:04.646 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-grafana-dashboards-2:18.0.0-2739.g472aaef4.el8.noarch 2023-03-06T13:48:04.646 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-immutable-object-cache-2:18.0.0-2739.g472aaef4.el8.x86_64 2023-03-06T13:48:04.646 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-mds-2:18.0.0-2739.g472aaef4.el8.x86_64 2023-03-06T13:48:04.646 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-mgr-2:18.0.0-2739.g472aaef4.el8.x86_64 2023-03-06T13:48:04.647 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-mgr-cephadm-2:18.0.0-2739.g472aaef4.el8.noarch 2023-03-06T13:48:04.647 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-mgr-dashboard-2:18.0.0-2739.g472aaef4.el8.noarch 2023-03-06T13:48:04.647 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-mgr-diskprediction-local-2:18.0.0-2739.g472aaef4.el8.noarch 2023-03-06T13:48:04.647 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-mgr-modules-core-2:18.0.0-2739.g472aaef4.el8.noarch 2023-03-06T13:48:04.648 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-mgr-rook-2:18.0.0-2739.g472aaef4.el8.noarch 2023-03-06T13:48:04.648 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-mon-2:18.0.0-2739.g472aaef4.el8.x86_64 2023-03-06T13:48:04.648 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-osd-2:18.0.0-2739.g472aaef4.el8.x86_64 2023-03-06T13:48:04.648 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-prometheus-alerts-2:18.0.0-2739.g472aaef4.el8.noarch 2023-03-06T13:48:04.648 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-radosgw-2:18.0.0-2739.g472aaef4.el8.x86_64 2023-03-06T13:48:04.649 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-selinux-2:18.0.0-2739.g472aaef4.el8.x86_64 2023-03-06T13:48:04.649 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-test-2:18.0.0-2739.g472aaef4.el8.x86_64 2023-03-06T13:48:04.649 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-volume-2:18.0.0-2739.g472aaef4.el8.noarch 2023-03-06T13:48:04.649 INFO:teuthology.orchestra.run.smithi086.stdout: cephadm-2:18.0.0-2739.g472aaef4.el8.noarch 2023-03-06T13:48:04.650 INFO:teuthology.orchestra.run.smithi086.stdout: cephfs-mirror-2:18.0.0-2739.g472aaef4.el8.x86_64 2023-03-06T13:48:04.650 INFO:teuthology.orchestra.run.smithi086.stdout: cephfs-top-2:18.0.0-2739.g472aaef4.el8.noarch 2023-03-06T13:48:04.650 INFO:teuthology.orchestra.run.smithi086.stdout: elfutils-libelf-devel-0.186-1.el8.x86_64 2023-03-06T13:48:04.650 INFO:teuthology.orchestra.run.smithi086.stdout: flex-2.6.1-9.el8.x86_64 2023-03-06T13:48:04.651 INFO:teuthology.orchestra.run.smithi086.stdout: fuse-2.9.7-15.el8.x86_64 2023-03-06T13:48:04.651 INFO:teuthology.orchestra.run.smithi086.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-03-06T13:48:04.651 INFO:teuthology.orchestra.run.smithi086.stdout: jq-1.6-3.el8.x86_64 2023-03-06T13:48:04.651 INFO:teuthology.orchestra.run.smithi086.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-03-06T13:48:04.651 INFO:teuthology.orchestra.run.smithi086.stdout: krb5-devel-1.18.2-14.el8.x86_64 2023-03-06T13:48:04.652 INFO:teuthology.orchestra.run.smithi086.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-03-06T13:48:04.652 INFO:teuthology.orchestra.run.smithi086.stdout: libcephfs-devel-2:18.0.0-2739.g472aaef4.el8.x86_64 2023-03-06T13:48:04.652 INFO:teuthology.orchestra.run.smithi086.stdout: libcephfs2-2:18.0.0-2739.g472aaef4.el8.x86_64 2023-03-06T13:48:04.652 INFO:teuthology.orchestra.run.smithi086.stdout: libcephsqlite-2:18.0.0-2739.g472aaef4.el8.x86_64 2023-03-06T13:48:04.652 INFO:teuthology.orchestra.run.smithi086.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2023-03-06T13:48:04.652 INFO:teuthology.orchestra.run.smithi086.stdout: libgfortran-8.5.0-10.1.el8_6.x86_64 2023-03-06T13:48:04.653 INFO:teuthology.orchestra.run.smithi086.stdout: liboath-2.6.2-3.el8.x86_64 2023-03-06T13:48:04.653 INFO:teuthology.orchestra.run.smithi086.stdout: libpq-13.5-1.el8.x86_64 2023-03-06T13:48:04.653 INFO:teuthology.orchestra.run.smithi086.stdout: libquadmath-8.5.0-10.1.el8_6.x86_64 2023-03-06T13:48:04.653 INFO:teuthology.orchestra.run.smithi086.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-03-06T13:48:04.653 INFO:teuthology.orchestra.run.smithi086.stdout: librados-devel-2:18.0.0-2739.g472aaef4.el8.x86_64 2023-03-06T13:48:04.653 INFO:teuthology.orchestra.run.smithi086.stdout: libradosstriper1-2:18.0.0-2739.g472aaef4.el8.x86_64 2023-03-06T13:48:04.654 INFO:teuthology.orchestra.run.smithi086.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-03-06T13:48:04.654 INFO:teuthology.orchestra.run.smithi086.stdout: librgw2-2:18.0.0-2739.g472aaef4.el8.x86_64 2023-03-06T13:48:04.654 INFO:teuthology.orchestra.run.smithi086.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-03-06T13:48:04.654 INFO:teuthology.orchestra.run.smithi086.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-03-06T13:48:04.654 INFO:teuthology.orchestra.run.smithi086.stdout: libtool-2.4.6-25.el8.x86_64 2023-03-06T13:48:04.655 INFO:teuthology.orchestra.run.smithi086.stdout: libunwind-1.3.1-3.el8.x86_64 2023-03-06T13:48:04.655 INFO:teuthology.orchestra.run.smithi086.stdout: libuuid-devel-2.32.1-35.el8.x86_64 2023-03-06T13:48:04.655 INFO:teuthology.orchestra.run.smithi086.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-03-06T13:48:04.655 INFO:teuthology.orchestra.run.smithi086.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-03-06T13:48:04.655 INFO:teuthology.orchestra.run.smithi086.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-03-06T13:48:04.655 INFO:teuthology.orchestra.run.smithi086.stdout: openblas-0.3.15-3.el8.x86_64 2023-03-06T13:48:04.655 INFO:teuthology.orchestra.run.smithi086.stdout: openblas-threads-0.3.15-3.el8.x86_64 2023-03-06T13:48:04.655 INFO:teuthology.orchestra.run.smithi086.stdout: openssl-devel-1:1.1.1k-7.el8_6.x86_64 2023-03-06T13:48:04.656 INFO:teuthology.orchestra.run.smithi086.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-03-06T13:48:04.656 INFO:teuthology.orchestra.run.smithi086.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-03-06T13:48:04.656 INFO:teuthology.orchestra.run.smithi086.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-03-06T13:48:04.656 INFO:teuthology.orchestra.run.smithi086.stdout: postgresql-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-03-06T13:48:04.656 INFO:teuthology.orchestra.run.smithi086.stdout: postgresql-contrib-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-03-06T13:48:04.656 INFO:teuthology.orchestra.run.smithi086.stdout: postgresql-server-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-03-06T13:48:04.656 INFO:teuthology.orchestra.run.smithi086.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-03-06T13:48:04.657 INFO:teuthology.orchestra.run.smithi086.stdout: python3-babel-2.5.1-7.el8.noarch 2023-03-06T13:48:04.657 INFO:teuthology.orchestra.run.smithi086.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-03-06T13:48:04.657 INFO:teuthology.orchestra.run.smithi086.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-03-06T13:48:04.657 INFO:teuthology.orchestra.run.smithi086.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-03-06T13:48:04.657 INFO:teuthology.orchestra.run.smithi086.stdout: python3-ceph-argparse-2:18.0.0-2739.g472aaef4.el8.x86_64 2023-03-06T13:48:04.657 INFO:teuthology.orchestra.run.smithi086.stdout: python3-ceph-common-2:18.0.0-2739.g472aaef4.el8.x86_64 2023-03-06T13:48:04.658 INFO:teuthology.orchestra.run.smithi086.stdout: python3-cephfs-2:18.0.0-2739.g472aaef4.el8.x86_64 2023-03-06T13:48:04.658 INFO:teuthology.orchestra.run.smithi086.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-03-06T13:48:04.658 INFO:teuthology.orchestra.run.smithi086.stdout: python3-cffi-1.11.5-5.el8.x86_64 2023-03-06T13:48:04.658 INFO:teuthology.orchestra.run.smithi086.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-03-06T13:48:04.658 INFO:teuthology.orchestra.run.smithi086.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-03-06T13:48:04.658 INFO:teuthology.orchestra.run.smithi086.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2023-03-06T13:48:04.658 INFO:teuthology.orchestra.run.smithi086.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-03-06T13:48:04.658 INFO:teuthology.orchestra.run.smithi086.stdout: python3-jaraco-6.2-6.el8.noarch 2023-03-06T13:48:04.659 INFO:teuthology.orchestra.run.smithi086.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-03-06T13:48:04.659 INFO:teuthology.orchestra.run.smithi086.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-03-06T13:48:04.659 INFO:teuthology.orchestra.run.smithi086.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-03-06T13:48:04.659 INFO:teuthology.orchestra.run.smithi086.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-03-06T13:48:04.659 INFO:teuthology.orchestra.run.smithi086.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-03-06T13:48:04.659 INFO:teuthology.orchestra.run.smithi086.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-03-06T13:48:04.659 INFO:teuthology.orchestra.run.smithi086.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-03-06T13:48:04.660 INFO:teuthology.orchestra.run.smithi086.stdout: python3-mako-1.0.6-13.el8.noarch 2023-03-06T13:48:04.660 INFO:teuthology.orchestra.run.smithi086.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-03-06T13:48:04.660 INFO:teuthology.orchestra.run.smithi086.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-03-06T13:48:04.660 INFO:teuthology.orchestra.run.smithi086.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-03-06T13:48:04.660 INFO:teuthology.orchestra.run.smithi086.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-03-06T13:48:04.660 INFO:teuthology.orchestra.run.smithi086.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-03-06T13:48:04.660 INFO:teuthology.orchestra.run.smithi086.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-03-06T13:48:04.660 INFO:teuthology.orchestra.run.smithi086.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-03-06T13:48:04.661 INFO:teuthology.orchestra.run.smithi086.stdout: python3-portend-2.6-1.el8.noarch 2023-03-06T13:48:04.661 INFO:teuthology.orchestra.run.smithi086.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-03-06T13:48:04.661 INFO:teuthology.orchestra.run.smithi086.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-03-06T13:48:04.661 INFO:teuthology.orchestra.run.smithi086.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-03-06T13:48:04.661 INFO:teuthology.orchestra.run.smithi086.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-03-06T13:48:04.661 INFO:teuthology.orchestra.run.smithi086.stdout: python3-pycparser-2.14-14.el8.noarch 2023-03-06T13:48:04.662 INFO:teuthology.orchestra.run.smithi086.stdout: python3-pytz-2017.2-9.el8.noarch 2023-03-06T13:48:04.662 INFO:teuthology.orchestra.run.smithi086.stdout: python3-rados-2:18.0.0-2739.g472aaef4.el8.x86_64 2023-03-06T13:48:04.662 INFO:teuthology.orchestra.run.smithi086.stdout: python3-rbd-2:18.0.0-2739.g472aaef4.el8.x86_64 2023-03-06T13:48:04.662 INFO:teuthology.orchestra.run.smithi086.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-03-06T13:48:04.662 INFO:teuthology.orchestra.run.smithi086.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-03-06T13:48:04.662 INFO:teuthology.orchestra.run.smithi086.stdout: python3-rgw-2:18.0.0-2739.g472aaef4.el8.x86_64 2023-03-06T13:48:04.662 INFO:teuthology.orchestra.run.smithi086.stdout: python3-routes-2.4.1-12.el8.noarch 2023-03-06T13:48:04.662 INFO:teuthology.orchestra.run.smithi086.stdout: python3-rsa-4.8-1.el8.noarch 2023-03-06T13:48:04.663 INFO:teuthology.orchestra.run.smithi086.stdout: python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd434d.x86_64 2023-03-06T13:48:04.663 INFO:teuthology.orchestra.run.smithi086.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-03-06T13:48:04.663 INFO:teuthology.orchestra.run.smithi086.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-03-06T13:48:04.663 INFO:teuthology.orchestra.run.smithi086.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-03-06T13:48:04.663 INFO:teuthology.orchestra.run.smithi086.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-03-06T13:48:04.663 INFO:teuthology.orchestra.run.smithi086.stdout: python3-waitress-1.2.1-2.el8.1.noarch 2023-03-06T13:48:04.663 INFO:teuthology.orchestra.run.smithi086.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-03-06T13:48:04.664 INFO:teuthology.orchestra.run.smithi086.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-03-06T13:48:04.664 INFO:teuthology.orchestra.run.smithi086.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-03-06T13:48:04.664 INFO:teuthology.orchestra.run.smithi086.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-03-06T13:48:04.664 INFO:teuthology.orchestra.run.smithi086.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-03-06T13:48:04.665 INFO:teuthology.orchestra.run.smithi086.stdout: rbd-fuse-2:18.0.0-2739.g472aaef4.el8.x86_64 2023-03-06T13:48:04.665 INFO:teuthology.orchestra.run.smithi086.stdout: rbd-mirror-2:18.0.0-2739.g472aaef4.el8.x86_64 2023-03-06T13:48:04.665 INFO:teuthology.orchestra.run.smithi086.stdout: rbd-nbd-2:18.0.0-2739.g472aaef4.el8.x86_64 2023-03-06T13:48:04.665 INFO:teuthology.orchestra.run.smithi086.stdout: socat-1.7.4.1-1.el8.x86_64 2023-03-06T13:48:04.666 INFO:teuthology.orchestra.run.smithi086.stdout: thrift-0.13.0-2.el8.x86_64 2023-03-06T13:48:04.666 INFO:teuthology.orchestra.run.smithi086.stdout: uuid-1.6.2-43.el8.x86_64 2023-03-06T13:48:04.666 INFO:teuthology.orchestra.run.smithi086.stdout: xfsprogs-devel-5.0.0-10.el8.x86_64 2023-03-06T13:48:04.666 INFO:teuthology.orchestra.run.smithi086.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-03-06T13:48:04.667 INFO:teuthology.orchestra.run.smithi086.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2023-03-06T13:48:04.667 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-03-06T13:48:04.667 INFO:teuthology.orchestra.run.smithi086.stdout:Complete! 2023-03-06T13:48:04.937 DEBUG:teuthology.parallel:result is None 2023-03-06T13:48:07.415 INFO:teuthology.orchestra.run.smithi202.stdout: Verifying : iproute-5.15.0-4.el8.x86_64 134/134 2023-03-06T13:48:07.415 INFO:teuthology.orchestra.run.smithi202.stdout:Last metadata expiration check: 0:01:53 ago on Mon 06 Mar 2023 01:46:14 PM UTC. 2023-03-06T13:48:10.081 INFO:teuthology.orchestra.run.smithi202.stdout:Installed products updated. 2023-03-06T13:48:10.340 INFO:teuthology.orchestra.run.smithi202.stdout: 2023-03-06T13:48:10.340 INFO:teuthology.orchestra.run.smithi202.stdout:Upgraded: 2023-03-06T13:48:10.340 INFO:teuthology.orchestra.run.smithi202.stdout: iproute-5.15.0-4.el8_6.1.x86_64 2023-03-06T13:48:10.340 INFO:teuthology.orchestra.run.smithi202.stdout: librados2-2:18.0.0-2739.g472aaef4.el8.x86_64 2023-03-06T13:48:10.341 INFO:teuthology.orchestra.run.smithi202.stdout: librbd1-2:18.0.0-2739.g472aaef4.el8.x86_64 2023-03-06T13:48:10.341 INFO:teuthology.orchestra.run.smithi202.stdout:Installed: 2023-03-06T13:48:10.341 INFO:teuthology.orchestra.run.smithi202.stdout: NetworkManager-initscripts-updown-1:1.36.0-9.el8_6.noarch 2023-03-06T13:48:10.341 INFO:teuthology.orchestra.run.smithi202.stdout: automake-1.16.1-7.el8.noarch 2023-03-06T13:48:10.341 INFO:teuthology.orchestra.run.smithi202.stdout: bison-3.0.4-10.el8.x86_64 2023-03-06T13:48:10.341 INFO:teuthology.orchestra.run.smithi202.stdout: ceph-2:18.0.0-2739.g472aaef4.el8.x86_64 2023-03-06T13:48:10.341 INFO:teuthology.orchestra.run.smithi202.stdout: ceph-base-2:18.0.0-2739.g472aaef4.el8.x86_64 2023-03-06T13:48:10.342 INFO:teuthology.orchestra.run.smithi202.stdout: ceph-common-2:18.0.0-2739.g472aaef4.el8.x86_64 2023-03-06T13:48:10.342 INFO:teuthology.orchestra.run.smithi202.stdout: ceph-fuse-2:18.0.0-2739.g472aaef4.el8.x86_64 2023-03-06T13:48:10.342 INFO:teuthology.orchestra.run.smithi202.stdout: ceph-grafana-dashboards-2:18.0.0-2739.g472aaef4.el8.noarch 2023-03-06T13:48:10.342 INFO:teuthology.orchestra.run.smithi202.stdout: ceph-immutable-object-cache-2:18.0.0-2739.g472aaef4.el8.x86_64 2023-03-06T13:48:10.342 INFO:teuthology.orchestra.run.smithi202.stdout: ceph-mds-2:18.0.0-2739.g472aaef4.el8.x86_64 2023-03-06T13:48:10.342 INFO:teuthology.orchestra.run.smithi202.stdout: ceph-mgr-2:18.0.0-2739.g472aaef4.el8.x86_64 2023-03-06T13:48:10.342 INFO:teuthology.orchestra.run.smithi202.stdout: ceph-mgr-cephadm-2:18.0.0-2739.g472aaef4.el8.noarch 2023-03-06T13:48:10.343 INFO:teuthology.orchestra.run.smithi202.stdout: ceph-mgr-dashboard-2:18.0.0-2739.g472aaef4.el8.noarch 2023-03-06T13:48:10.343 INFO:teuthology.orchestra.run.smithi202.stdout: ceph-mgr-diskprediction-local-2:18.0.0-2739.g472aaef4.el8.noarch 2023-03-06T13:48:10.343 INFO:teuthology.orchestra.run.smithi202.stdout: ceph-mgr-modules-core-2:18.0.0-2739.g472aaef4.el8.noarch 2023-03-06T13:48:10.343 INFO:teuthology.orchestra.run.smithi202.stdout: ceph-mgr-rook-2:18.0.0-2739.g472aaef4.el8.noarch 2023-03-06T13:48:10.343 INFO:teuthology.orchestra.run.smithi202.stdout: ceph-mon-2:18.0.0-2739.g472aaef4.el8.x86_64 2023-03-06T13:48:10.343 INFO:teuthology.orchestra.run.smithi202.stdout: ceph-osd-2:18.0.0-2739.g472aaef4.el8.x86_64 2023-03-06T13:48:10.343 INFO:teuthology.orchestra.run.smithi202.stdout: ceph-prometheus-alerts-2:18.0.0-2739.g472aaef4.el8.noarch 2023-03-06T13:48:10.344 INFO:teuthology.orchestra.run.smithi202.stdout: ceph-radosgw-2:18.0.0-2739.g472aaef4.el8.x86_64 2023-03-06T13:48:10.344 INFO:teuthology.orchestra.run.smithi202.stdout: ceph-selinux-2:18.0.0-2739.g472aaef4.el8.x86_64 2023-03-06T13:48:10.344 INFO:teuthology.orchestra.run.smithi202.stdout: ceph-test-2:18.0.0-2739.g472aaef4.el8.x86_64 2023-03-06T13:48:10.344 INFO:teuthology.orchestra.run.smithi202.stdout: ceph-volume-2:18.0.0-2739.g472aaef4.el8.noarch 2023-03-06T13:48:10.344 INFO:teuthology.orchestra.run.smithi202.stdout: cephadm-2:18.0.0-2739.g472aaef4.el8.noarch 2023-03-06T13:48:10.345 INFO:teuthology.orchestra.run.smithi202.stdout: cephfs-mirror-2:18.0.0-2739.g472aaef4.el8.x86_64 2023-03-06T13:48:10.345 INFO:teuthology.orchestra.run.smithi202.stdout: cephfs-top-2:18.0.0-2739.g472aaef4.el8.noarch 2023-03-06T13:48:10.345 INFO:teuthology.orchestra.run.smithi202.stdout: elfutils-libelf-devel-0.186-1.el8.x86_64 2023-03-06T13:48:10.345 INFO:teuthology.orchestra.run.smithi202.stdout: flex-2.6.1-9.el8.x86_64 2023-03-06T13:48:10.345 INFO:teuthology.orchestra.run.smithi202.stdout: fuse-2.9.7-15.el8.x86_64 2023-03-06T13:48:10.345 INFO:teuthology.orchestra.run.smithi202.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-03-06T13:48:10.346 INFO:teuthology.orchestra.run.smithi202.stdout: jq-1.6-3.el8.x86_64 2023-03-06T13:48:10.346 INFO:teuthology.orchestra.run.smithi202.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-03-06T13:48:10.346 INFO:teuthology.orchestra.run.smithi202.stdout: krb5-devel-1.18.2-14.el8.x86_64 2023-03-06T13:48:10.346 INFO:teuthology.orchestra.run.smithi202.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-03-06T13:48:10.346 INFO:teuthology.orchestra.run.smithi202.stdout: libcephfs-devel-2:18.0.0-2739.g472aaef4.el8.x86_64 2023-03-06T13:48:10.346 INFO:teuthology.orchestra.run.smithi202.stdout: libcephfs2-2:18.0.0-2739.g472aaef4.el8.x86_64 2023-03-06T13:48:10.346 INFO:teuthology.orchestra.run.smithi202.stdout: libcephsqlite-2:18.0.0-2739.g472aaef4.el8.x86_64 2023-03-06T13:48:10.347 INFO:teuthology.orchestra.run.smithi202.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2023-03-06T13:48:10.347 INFO:teuthology.orchestra.run.smithi202.stdout: libgfortran-8.5.0-10.1.el8_6.x86_64 2023-03-06T13:48:10.347 INFO:teuthology.orchestra.run.smithi202.stdout: liboath-2.6.2-3.el8.x86_64 2023-03-06T13:48:10.347 INFO:teuthology.orchestra.run.smithi202.stdout: libpq-13.5-1.el8.x86_64 2023-03-06T13:48:10.347 INFO:teuthology.orchestra.run.smithi202.stdout: libquadmath-8.5.0-10.1.el8_6.x86_64 2023-03-06T13:48:10.347 INFO:teuthology.orchestra.run.smithi202.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-03-06T13:48:10.347 INFO:teuthology.orchestra.run.smithi202.stdout: librados-devel-2:18.0.0-2739.g472aaef4.el8.x86_64 2023-03-06T13:48:10.347 INFO:teuthology.orchestra.run.smithi202.stdout: libradosstriper1-2:18.0.0-2739.g472aaef4.el8.x86_64 2023-03-06T13:48:10.348 INFO:teuthology.orchestra.run.smithi202.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-03-06T13:48:10.348 INFO:teuthology.orchestra.run.smithi202.stdout: librgw2-2:18.0.0-2739.g472aaef4.el8.x86_64 2023-03-06T13:48:10.348 INFO:teuthology.orchestra.run.smithi202.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-03-06T13:48:10.348 INFO:teuthology.orchestra.run.smithi202.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-03-06T13:48:10.348 INFO:teuthology.orchestra.run.smithi202.stdout: libtool-2.4.6-25.el8.x86_64 2023-03-06T13:48:10.348 INFO:teuthology.orchestra.run.smithi202.stdout: libunwind-1.3.1-3.el8.x86_64 2023-03-06T13:48:10.348 INFO:teuthology.orchestra.run.smithi202.stdout: libuuid-devel-2.32.1-35.el8.x86_64 2023-03-06T13:48:10.349 INFO:teuthology.orchestra.run.smithi202.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-03-06T13:48:10.349 INFO:teuthology.orchestra.run.smithi202.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-03-06T13:48:10.349 INFO:teuthology.orchestra.run.smithi202.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-03-06T13:48:10.349 INFO:teuthology.orchestra.run.smithi202.stdout: openblas-0.3.15-3.el8.x86_64 2023-03-06T13:48:10.349 INFO:teuthology.orchestra.run.smithi202.stdout: openblas-threads-0.3.15-3.el8.x86_64 2023-03-06T13:48:10.349 INFO:teuthology.orchestra.run.smithi202.stdout: openssl-devel-1:1.1.1k-7.el8_6.x86_64 2023-03-06T13:48:10.349 INFO:teuthology.orchestra.run.smithi202.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-03-06T13:48:10.350 INFO:teuthology.orchestra.run.smithi202.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-03-06T13:48:10.350 INFO:teuthology.orchestra.run.smithi202.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-03-06T13:48:10.350 INFO:teuthology.orchestra.run.smithi202.stdout: postgresql-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-03-06T13:48:10.350 INFO:teuthology.orchestra.run.smithi202.stdout: postgresql-contrib-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-03-06T13:48:10.350 INFO:teuthology.orchestra.run.smithi202.stdout: postgresql-server-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-03-06T13:48:10.350 INFO:teuthology.orchestra.run.smithi202.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-03-06T13:48:10.350 INFO:teuthology.orchestra.run.smithi202.stdout: python3-babel-2.5.1-7.el8.noarch 2023-03-06T13:48:10.351 INFO:teuthology.orchestra.run.smithi202.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-03-06T13:48:10.351 INFO:teuthology.orchestra.run.smithi202.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-03-06T13:48:10.351 INFO:teuthology.orchestra.run.smithi202.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-03-06T13:48:10.351 INFO:teuthology.orchestra.run.smithi202.stdout: python3-ceph-argparse-2:18.0.0-2739.g472aaef4.el8.x86_64 2023-03-06T13:48:10.351 INFO:teuthology.orchestra.run.smithi202.stdout: python3-ceph-common-2:18.0.0-2739.g472aaef4.el8.x86_64 2023-03-06T13:48:10.351 INFO:teuthology.orchestra.run.smithi202.stdout: python3-cephfs-2:18.0.0-2739.g472aaef4.el8.x86_64 2023-03-06T13:48:10.351 INFO:teuthology.orchestra.run.smithi202.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-03-06T13:48:10.352 INFO:teuthology.orchestra.run.smithi202.stdout: python3-cffi-1.11.5-5.el8.x86_64 2023-03-06T13:48:10.352 INFO:teuthology.orchestra.run.smithi202.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-03-06T13:48:10.352 INFO:teuthology.orchestra.run.smithi202.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-03-06T13:48:10.352 INFO:teuthology.orchestra.run.smithi202.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2023-03-06T13:48:10.352 INFO:teuthology.orchestra.run.smithi202.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-03-06T13:48:10.352 INFO:teuthology.orchestra.run.smithi202.stdout: python3-jaraco-6.2-6.el8.noarch 2023-03-06T13:48:10.352 INFO:teuthology.orchestra.run.smithi202.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-03-06T13:48:10.353 INFO:teuthology.orchestra.run.smithi202.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-03-06T13:48:10.353 INFO:teuthology.orchestra.run.smithi202.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-03-06T13:48:10.353 INFO:teuthology.orchestra.run.smithi202.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-03-06T13:48:10.353 INFO:teuthology.orchestra.run.smithi202.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-03-06T13:48:10.353 INFO:teuthology.orchestra.run.smithi202.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-03-06T13:48:10.353 INFO:teuthology.orchestra.run.smithi202.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-03-06T13:48:10.354 INFO:teuthology.orchestra.run.smithi202.stdout: python3-mako-1.0.6-13.el8.noarch 2023-03-06T13:48:10.354 INFO:teuthology.orchestra.run.smithi202.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-03-06T13:48:10.354 INFO:teuthology.orchestra.run.smithi202.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-03-06T13:48:10.354 INFO:teuthology.orchestra.run.smithi202.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-03-06T13:48:10.354 INFO:teuthology.orchestra.run.smithi202.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-03-06T13:48:10.354 INFO:teuthology.orchestra.run.smithi202.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-03-06T13:48:10.354 INFO:teuthology.orchestra.run.smithi202.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-03-06T13:48:10.355 INFO:teuthology.orchestra.run.smithi202.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-03-06T13:48:10.355 INFO:teuthology.orchestra.run.smithi202.stdout: python3-portend-2.6-1.el8.noarch 2023-03-06T13:48:10.355 INFO:teuthology.orchestra.run.smithi202.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-03-06T13:48:10.355 INFO:teuthology.orchestra.run.smithi202.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-03-06T13:48:10.355 INFO:teuthology.orchestra.run.smithi202.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-03-06T13:48:10.355 INFO:teuthology.orchestra.run.smithi202.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-03-06T13:48:10.356 INFO:teuthology.orchestra.run.smithi202.stdout: python3-pycparser-2.14-14.el8.noarch 2023-03-06T13:48:10.356 INFO:teuthology.orchestra.run.smithi202.stdout: python3-pytz-2017.2-9.el8.noarch 2023-03-06T13:48:10.356 INFO:teuthology.orchestra.run.smithi202.stdout: python3-rados-2:18.0.0-2739.g472aaef4.el8.x86_64 2023-03-06T13:48:10.356 INFO:teuthology.orchestra.run.smithi202.stdout: python3-rbd-2:18.0.0-2739.g472aaef4.el8.x86_64 2023-03-06T13:48:10.356 INFO:teuthology.orchestra.run.smithi202.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-03-06T13:48:10.356 INFO:teuthology.orchestra.run.smithi202.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-03-06T13:48:10.356 INFO:teuthology.orchestra.run.smithi202.stdout: python3-rgw-2:18.0.0-2739.g472aaef4.el8.x86_64 2023-03-06T13:48:10.357 INFO:teuthology.orchestra.run.smithi202.stdout: python3-routes-2.4.1-12.el8.noarch 2023-03-06T13:48:10.357 INFO:teuthology.orchestra.run.smithi202.stdout: python3-rsa-4.8-1.el8.noarch 2023-03-06T13:48:10.357 INFO:teuthology.orchestra.run.smithi202.stdout: python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd434d.x86_64 2023-03-06T13:48:10.357 INFO:teuthology.orchestra.run.smithi202.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-03-06T13:48:10.357 INFO:teuthology.orchestra.run.smithi202.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-03-06T13:48:10.357 INFO:teuthology.orchestra.run.smithi202.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-03-06T13:48:10.358 INFO:teuthology.orchestra.run.smithi202.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-03-06T13:48:10.358 INFO:teuthology.orchestra.run.smithi202.stdout: python3-waitress-1.2.1-2.el8.1.noarch 2023-03-06T13:48:10.358 INFO:teuthology.orchestra.run.smithi202.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-03-06T13:48:10.358 INFO:teuthology.orchestra.run.smithi202.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-03-06T13:48:10.358 INFO:teuthology.orchestra.run.smithi202.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-03-06T13:48:10.359 INFO:teuthology.orchestra.run.smithi202.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-03-06T13:48:10.359 INFO:teuthology.orchestra.run.smithi202.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-03-06T13:48:10.359 INFO:teuthology.orchestra.run.smithi202.stdout: rbd-fuse-2:18.0.0-2739.g472aaef4.el8.x86_64 2023-03-06T13:48:10.359 INFO:teuthology.orchestra.run.smithi202.stdout: rbd-mirror-2:18.0.0-2739.g472aaef4.el8.x86_64 2023-03-06T13:48:10.359 INFO:teuthology.orchestra.run.smithi202.stdout: rbd-nbd-2:18.0.0-2739.g472aaef4.el8.x86_64 2023-03-06T13:48:10.359 INFO:teuthology.orchestra.run.smithi202.stdout: socat-1.7.4.1-1.el8.x86_64 2023-03-06T13:48:10.359 INFO:teuthology.orchestra.run.smithi202.stdout: thrift-0.13.0-2.el8.x86_64 2023-03-06T13:48:10.360 INFO:teuthology.orchestra.run.smithi202.stdout: uuid-1.6.2-43.el8.x86_64 2023-03-06T13:48:10.360 INFO:teuthology.orchestra.run.smithi202.stdout: xfsprogs-devel-5.0.0-10.el8.x86_64 2023-03-06T13:48:10.360 INFO:teuthology.orchestra.run.smithi202.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-03-06T13:48:10.360 INFO:teuthology.orchestra.run.smithi202.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2023-03-06T13:48:10.361 INFO:teuthology.orchestra.run.smithi202.stdout: 2023-03-06T13:48:10.361 INFO:teuthology.orchestra.run.smithi202.stdout:Complete! 2023-03-06T13:48:10.513 DEBUG:teuthology.parallel:result is None 2023-03-06T13:48:10.514 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=472aaef4ec3b3a2c29f73ca67854785a910f1f9b 2023-03-06T13:48:10.658 DEBUG:teuthology.orchestra.run.smithi086:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-03-06T13:48:10.687 INFO:teuthology.orchestra.run.smithi086.stdout:18.0.0-2739.g472aaef4.el8 2023-03-06T13:48:10.688 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-2739.g472aaef4.el8 2023-03-06T13:48:10.688 INFO:teuthology.task.install:The correct ceph version 18.0.0-2739.g472aaef4 is installed. 2023-03-06T13:48:10.688 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=472aaef4ec3b3a2c29f73ca67854785a910f1f9b 2023-03-06T13:48:10.829 DEBUG:teuthology.orchestra.run.smithi202:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-03-06T13:48:10.853 INFO:teuthology.orchestra.run.smithi202.stdout:18.0.0-2739.g472aaef4.el8 2023-03-06T13:48:10.854 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-2739.g472aaef4.el8 2023-03-06T13:48:10.855 INFO:teuthology.task.install:The correct ceph version 18.0.0-2739.g472aaef4 is installed. 2023-03-06T13:48:10.855 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-03-06T13:48:10.856 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2023-03-06T13:48:10.856 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-03-06T13:48:10.902 DEBUG:teuthology.orchestra.run.smithi202:> set -ex 2023-03-06T13:48:10.903 DEBUG:teuthology.orchestra.run.smithi202:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-03-06T13:48:10.942 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-03-06T13:48:10.942 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2023-03-06T13:48:10.943 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd of=/usr/bin/daemon-helper 2023-03-06T13:48:10.972 DEBUG:teuthology.orchestra.run.smithi086:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-03-06T13:48:11.040 DEBUG:teuthology.orchestra.run.smithi202:> set -ex 2023-03-06T13:48:11.041 DEBUG:teuthology.orchestra.run.smithi202:> sudo dd of=/usr/bin/daemon-helper 2023-03-06T13:48:11.068 DEBUG:teuthology.orchestra.run.smithi202:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-03-06T13:48:11.134 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-03-06T13:48:11.135 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2023-03-06T13:48:11.135 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd of=/usr/bin/adjust-ulimits 2023-03-06T13:48:11.162 DEBUG:teuthology.orchestra.run.smithi086:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-03-06T13:48:11.229 DEBUG:teuthology.orchestra.run.smithi202:> set -ex 2023-03-06T13:48:11.230 DEBUG:teuthology.orchestra.run.smithi202:> sudo dd of=/usr/bin/adjust-ulimits 2023-03-06T13:48:11.256 DEBUG:teuthology.orchestra.run.smithi202:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-03-06T13:48:11.322 INFO:teuthology.run_tasks:Running task ceph... 2023-03-06T13:48:11.403 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-03-06T13:48:11.404 DEBUG:teuthology.orchestra.run.smithi086:> sudo chmod 777 /var/log/ceph 2023-03-06T13:48:11.407 DEBUG:teuthology.orchestra.run.smithi202:> sudo chmod 777 /var/log/ceph 2023-03-06T13:48:11.433 INFO:tasks.ceph:Disabling ceph logrotate... 2023-03-06T13:48:11.433 DEBUG:teuthology.orchestra.run.smithi086:> sudo rm -f -- /etc/logrotate.d/ceph 2023-03-06T13:48:11.476 DEBUG:teuthology.orchestra.run.smithi202:> sudo rm -f -- /etc/logrotate.d/ceph 2023-03-06T13:48:11.502 INFO:tasks.ceph:Creating extra log directories... 2023-03-06T13:48:11.504 DEBUG:teuthology.orchestra.run.smithi086:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-03-06T13:48:11.544 DEBUG:teuthology.orchestra.run.smithi202:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-03-06T13:48:11.578 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-03-06T13:48:11.579 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-03-06T13:48:11.579 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-03-06T13:48:11.579 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2023-03-06T13:48:11.580 DEBUG:teuthology.orchestra.run.smithi086:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-03-06T13:48:11.625 DEBUG:teuthology.orchestra.run.smithi086:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-03-06T13:48:11.984 DEBUG:teuthology.orchestra.run.smithi086:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-03-06T13:48:12.012 DEBUG:teuthology.orchestra.run.smithi202:> set -ex 2023-03-06T13:48:12.012 DEBUG:teuthology.orchestra.run.smithi202:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-03-06T13:48:12.031 DEBUG:teuthology.orchestra.run.smithi202:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-03-06T13:48:12.161 DEBUG:teuthology.orchestra.run.smithi202:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-03-06T13:48:12.194 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-03-06T13:48:12.195 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-03-06T13:48:12.195 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/vshankar-2023-03-06_13:28:53-fs-wip-vshankar-testing-20230303.023823-testing-default-smithi/7195189', 'branch': 'wip-vshankar-testing-20230303.023823', 'description': 'fs/snaps/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/workunit/snaps}', 'email': 'vshankar@redhat.com', 'first_in_suite': False, 'job_id': '7195189', 'kernel': {'client': {'sha1': 'distro'}, 'flavor': 'default', 'kdb': True, 'sha1': '75534f74ac3dd06f86697ff862e8be2945b3c8e6'}, 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'vshankar-2023-03-06_13:28:53-fs-wip-vshankar-testing-20230303.023823-testing-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'rhel', 'os_version': '8.6', 'overrides': {'admin_socket': {'branch': 'wip-vshankar-testing-20230303.023823'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': '472aaef4ec3b3a2c29f73ca67854785a910f1f9b'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '472aaef4ec3b3a2c29f73ca67854785a910f1f9b'}}, 'kclient': {'syntax': 'v2'}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-vshankar-testing-20230303.023823', 'sha1': '472aaef4ec3b3a2c29f73ca67854785a910f1f9b'}}, 'owner': 'scheduled_vshankar@teuthology', 'priority': 30, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7']], 'sha1': '472aaef4ec3b3a2c29f73ca67854785a910f1f9b', 'sleep_before_teardown': 0, 'suite': 'fs', 'suite_branch': 'wip-vshankar-testing-20230303.023823', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_472aaef4ec3b3a2c29f73ca67854785a910f1f9b/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': '472aaef4ec3b3a2c29f73ca67854785a910f1f9b', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi086.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs=', 'smithi202.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'sha1': 'distro'}, 'flavor': 'default', 'kdb': True, 'sha1': '75534f74ac3dd06f86697ff862e8be2945b3c8e6'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '472aaef4ec3b3a2c29f73ca67854785a910f1f9b'}}, {'ceph': None}, {'kclient': None}, {'workunit': {'clients': {'all': ['fs/snaps']}, 'timeout': '6h'}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': 'a2dfb0599b24ec4a1585108a2792a4567ce0a378', 'timestamp': '2023-03-06_13:28:53', 'tube': 'smithi', 'use_shaman': True, 'user': 'vshankar', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.31660'} 2023-03-06T13:48:12.196 DEBUG:teuthology.orchestra.run.smithi086:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-03-06T13:48:12.198 DEBUG:teuthology.orchestra.run.smithi202:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-03-06T13:48:12.246 DEBUG:teuthology.orchestra.run.smithi086:> sudo install -d -m0777 -- /var/run/ceph 2023-03-06T13:48:12.257 DEBUG:teuthology.orchestra.run.smithi202:> sudo install -d -m0777 -- /var/run/ceph 2023-03-06T13:48:12.312 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2023-03-06T13:48:12.313 DEBUG:teuthology.orchestra.run.smithi086:> dd if=/scratch_devs of=/dev/stdout 2023-03-06T13:48:12.342 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-03-06T13:48:12.342 DEBUG:teuthology.orchestra.run.smithi086:> stat /dev/vg_nvme/lv_1 2023-03-06T13:48:12.400 INFO:teuthology.orchestra.run.smithi086.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-03-06T13:48:12.400 INFO:teuthology.orchestra.run.smithi086.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-03-06T13:48:12.401 INFO:teuthology.orchestra.run.smithi086.stdout:Device: 6h/6d Inode: 353022 Links: 1 2023-03-06T13:48:12.401 INFO:teuthology.orchestra.run.smithi086.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-03-06T13:48:12.401 INFO:teuthology.orchestra.run.smithi086.stdout:Context: system_u:object_r:device_t:s0 2023-03-06T13:48:12.401 INFO:teuthology.orchestra.run.smithi086.stdout:Access: 2023-03-06 13:47:58.869682839 +0000 2023-03-06T13:48:12.401 INFO:teuthology.orchestra.run.smithi086.stdout:Modify: 2023-03-06 13:45:22.979737270 +0000 2023-03-06T13:48:12.401 INFO:teuthology.orchestra.run.smithi086.stdout:Change: 2023-03-06 13:45:22.979737270 +0000 2023-03-06T13:48:12.401 INFO:teuthology.orchestra.run.smithi086.stdout: Birth: - 2023-03-06T13:48:12.402 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-03-06T13:48:12.468 INFO:teuthology.orchestra.run.smithi086.stderr:1+0 records in 2023-03-06T13:48:12.468 INFO:teuthology.orchestra.run.smithi086.stderr:1+0 records out 2023-03-06T13:48:12.468 INFO:teuthology.orchestra.run.smithi086.stderr:512 bytes copied, 0.000255192 s, 2.0 MB/s 2023-03-06T13:48:12.469 DEBUG:teuthology.orchestra.run.smithi086:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-03-06T13:48:12.528 DEBUG:teuthology.orchestra.run.smithi086:> stat /dev/vg_nvme/lv_2 2023-03-06T13:48:12.587 INFO:teuthology.orchestra.run.smithi086.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-03-06T13:48:12.587 INFO:teuthology.orchestra.run.smithi086.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-03-06T13:48:12.587 INFO:teuthology.orchestra.run.smithi086.stdout:Device: 6h/6d Inode: 363521 Links: 1 2023-03-06T13:48:12.587 INFO:teuthology.orchestra.run.smithi086.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-03-06T13:48:12.587 INFO:teuthology.orchestra.run.smithi086.stdout:Context: system_u:object_r:device_t:s0 2023-03-06T13:48:12.588 INFO:teuthology.orchestra.run.smithi086.stdout:Access: 2023-03-06 13:47:58.870682816 +0000 2023-03-06T13:48:12.588 INFO:teuthology.orchestra.run.smithi086.stdout:Modify: 2023-03-06 13:45:23.509725267 +0000 2023-03-06T13:48:12.588 INFO:teuthology.orchestra.run.smithi086.stdout:Change: 2023-03-06 13:45:23.509725267 +0000 2023-03-06T13:48:12.588 INFO:teuthology.orchestra.run.smithi086.stdout: Birth: - 2023-03-06T13:48:12.589 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-03-06T13:48:12.652 INFO:teuthology.orchestra.run.smithi086.stderr:1+0 records in 2023-03-06T13:48:12.653 INFO:teuthology.orchestra.run.smithi086.stderr:1+0 records out 2023-03-06T13:48:12.653 INFO:teuthology.orchestra.run.smithi086.stderr:512 bytes copied, 0.000225388 s, 2.3 MB/s 2023-03-06T13:48:12.654 DEBUG:teuthology.orchestra.run.smithi086:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-03-06T13:48:12.712 DEBUG:teuthology.orchestra.run.smithi086:> stat /dev/vg_nvme/lv_3 2023-03-06T13:48:12.770 INFO:teuthology.orchestra.run.smithi086.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-03-06T13:48:12.770 INFO:teuthology.orchestra.run.smithi086.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-03-06T13:48:12.770 INFO:teuthology.orchestra.run.smithi086.stdout:Device: 6h/6d Inode: 362673 Links: 1 2023-03-06T13:48:12.771 INFO:teuthology.orchestra.run.smithi086.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-03-06T13:48:12.771 INFO:teuthology.orchestra.run.smithi086.stdout:Context: system_u:object_r:device_t:s0 2023-03-06T13:48:12.771 INFO:teuthology.orchestra.run.smithi086.stdout:Access: 2023-03-06 13:47:58.870682816 +0000 2023-03-06T13:48:12.771 INFO:teuthology.orchestra.run.smithi086.stdout:Modify: 2023-03-06 13:45:24.052712969 +0000 2023-03-06T13:48:12.771 INFO:teuthology.orchestra.run.smithi086.stdout:Change: 2023-03-06 13:45:24.052712969 +0000 2023-03-06T13:48:12.771 INFO:teuthology.orchestra.run.smithi086.stdout: Birth: - 2023-03-06T13:48:12.774 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-03-06T13:48:12.835 INFO:teuthology.orchestra.run.smithi086.stderr:1+0 records in 2023-03-06T13:48:12.835 INFO:teuthology.orchestra.run.smithi086.stderr:1+0 records out 2023-03-06T13:48:12.835 INFO:teuthology.orchestra.run.smithi086.stderr:512 bytes copied, 0.00023517 s, 2.2 MB/s 2023-03-06T13:48:12.836 DEBUG:teuthology.orchestra.run.smithi086:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-03-06T13:48:12.894 DEBUG:teuthology.orchestra.run.smithi086:> stat /dev/vg_nvme/lv_4 2023-03-06T13:48:12.951 INFO:teuthology.orchestra.run.smithi086.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-03-06T13:48:12.952 INFO:teuthology.orchestra.run.smithi086.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-03-06T13:48:12.952 INFO:teuthology.orchestra.run.smithi086.stdout:Device: 6h/6d Inode: 361740 Links: 1 2023-03-06T13:48:12.952 INFO:teuthology.orchestra.run.smithi086.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-03-06T13:48:12.952 INFO:teuthology.orchestra.run.smithi086.stdout:Context: system_u:object_r:device_t:s0 2023-03-06T13:48:12.952 INFO:teuthology.orchestra.run.smithi086.stdout:Access: 2023-03-06 13:47:58.870682816 +0000 2023-03-06T13:48:12.953 INFO:teuthology.orchestra.run.smithi086.stdout:Modify: 2023-03-06 13:45:24.581700987 +0000 2023-03-06T13:48:12.953 INFO:teuthology.orchestra.run.smithi086.stdout:Change: 2023-03-06 13:45:24.581700987 +0000 2023-03-06T13:48:12.953 INFO:teuthology.orchestra.run.smithi086.stdout: Birth: - 2023-03-06T13:48:12.953 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-03-06T13:48:13.016 INFO:teuthology.orchestra.run.smithi086.stderr:1+0 records in 2023-03-06T13:48:13.017 INFO:teuthology.orchestra.run.smithi086.stderr:1+0 records out 2023-03-06T13:48:13.017 INFO:teuthology.orchestra.run.smithi086.stderr:512 bytes copied, 0.000180213 s, 2.8 MB/s 2023-03-06T13:48:13.018 DEBUG:teuthology.orchestra.run.smithi086:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-03-06T13:48:13.076 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-03-06T13:48:13.077 DEBUG:teuthology.orchestra.run.smithi202:> set -ex 2023-03-06T13:48:13.077 DEBUG:teuthology.orchestra.run.smithi202:> dd if=/scratch_devs of=/dev/stdout 2023-03-06T13:48:13.096 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-03-06T13:48:13.096 DEBUG:teuthology.orchestra.run.smithi202:> stat /dev/vg_nvme/lv_1 2023-03-06T13:48:13.154 INFO:teuthology.orchestra.run.smithi202.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-03-06T13:48:13.155 INFO:teuthology.orchestra.run.smithi202.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-03-06T13:48:13.155 INFO:teuthology.orchestra.run.smithi202.stdout:Device: 6h/6d Inode: 358860 Links: 1 2023-03-06T13:48:13.155 INFO:teuthology.orchestra.run.smithi202.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-03-06T13:48:13.155 INFO:teuthology.orchestra.run.smithi202.stdout:Context: system_u:object_r:device_t:s0 2023-03-06T13:48:13.155 INFO:teuthology.orchestra.run.smithi202.stdout:Access: 2023-03-06 13:48:04.314137938 +0000 2023-03-06T13:48:13.155 INFO:teuthology.orchestra.run.smithi202.stdout:Modify: 2023-03-06 13:45:29.029278798 +0000 2023-03-06T13:48:13.156 INFO:teuthology.orchestra.run.smithi202.stdout:Change: 2023-03-06 13:45:29.029278798 +0000 2023-03-06T13:48:13.156 INFO:teuthology.orchestra.run.smithi202.stdout: Birth: - 2023-03-06T13:48:13.156 DEBUG:teuthology.orchestra.run.smithi202:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-03-06T13:48:13.220 INFO:teuthology.orchestra.run.smithi202.stderr:1+0 records in 2023-03-06T13:48:13.220 INFO:teuthology.orchestra.run.smithi202.stderr:1+0 records out 2023-03-06T13:48:13.220 INFO:teuthology.orchestra.run.smithi202.stderr:512 bytes copied, 0.00023578 s, 2.2 MB/s 2023-03-06T13:48:13.221 DEBUG:teuthology.orchestra.run.smithi202:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-03-06T13:48:13.280 DEBUG:teuthology.orchestra.run.smithi202:> stat /dev/vg_nvme/lv_2 2023-03-06T13:48:13.338 INFO:teuthology.orchestra.run.smithi202.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-03-06T13:48:13.338 INFO:teuthology.orchestra.run.smithi202.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-03-06T13:48:13.338 INFO:teuthology.orchestra.run.smithi202.stdout:Device: 6h/6d Inode: 358943 Links: 1 2023-03-06T13:48:13.338 INFO:teuthology.orchestra.run.smithi202.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-03-06T13:48:13.338 INFO:teuthology.orchestra.run.smithi202.stdout:Context: system_u:object_r:device_t:s0 2023-03-06T13:48:13.339 INFO:teuthology.orchestra.run.smithi202.stdout:Access: 2023-03-06 13:48:04.314137938 +0000 2023-03-06T13:48:13.339 INFO:teuthology.orchestra.run.smithi202.stdout:Modify: 2023-03-06 13:45:29.596267745 +0000 2023-03-06T13:48:13.339 INFO:teuthology.orchestra.run.smithi202.stdout:Change: 2023-03-06 13:45:29.596267745 +0000 2023-03-06T13:48:13.339 INFO:teuthology.orchestra.run.smithi202.stdout: Birth: - 2023-03-06T13:48:13.339 DEBUG:teuthology.orchestra.run.smithi202:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-03-06T13:48:13.403 INFO:teuthology.orchestra.run.smithi202.stderr:1+0 records in 2023-03-06T13:48:13.403 INFO:teuthology.orchestra.run.smithi202.stderr:1+0 records out 2023-03-06T13:48:13.404 INFO:teuthology.orchestra.run.smithi202.stderr:512 bytes copied, 0.000209627 s, 2.4 MB/s 2023-03-06T13:48:13.405 DEBUG:teuthology.orchestra.run.smithi202:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-03-06T13:48:13.462 DEBUG:teuthology.orchestra.run.smithi202:> stat /dev/vg_nvme/lv_3 2023-03-06T13:48:13.518 INFO:teuthology.orchestra.run.smithi202.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-03-06T13:48:13.519 INFO:teuthology.orchestra.run.smithi202.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-03-06T13:48:13.519 INFO:teuthology.orchestra.run.smithi202.stdout:Device: 6h/6d Inode: 354123 Links: 1 2023-03-06T13:48:13.519 INFO:teuthology.orchestra.run.smithi202.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-03-06T13:48:13.519 INFO:teuthology.orchestra.run.smithi202.stdout:Context: system_u:object_r:device_t:s0 2023-03-06T13:48:13.519 INFO:teuthology.orchestra.run.smithi202.stdout:Access: 2023-03-06 13:48:04.314137938 +0000 2023-03-06T13:48:13.520 INFO:teuthology.orchestra.run.smithi202.stdout:Modify: 2023-03-06 13:45:30.176256439 +0000 2023-03-06T13:48:13.520 INFO:teuthology.orchestra.run.smithi202.stdout:Change: 2023-03-06 13:45:30.176256439 +0000 2023-03-06T13:48:13.520 INFO:teuthology.orchestra.run.smithi202.stdout: Birth: - 2023-03-06T13:48:13.520 DEBUG:teuthology.orchestra.run.smithi202:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-03-06T13:48:13.584 INFO:teuthology.orchestra.run.smithi202.stderr:1+0 records in 2023-03-06T13:48:13.584 INFO:teuthology.orchestra.run.smithi202.stderr:1+0 records out 2023-03-06T13:48:13.584 INFO:teuthology.orchestra.run.smithi202.stderr:512 bytes copied, 0.000225969 s, 2.3 MB/s 2023-03-06T13:48:13.585 DEBUG:teuthology.orchestra.run.smithi202:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-03-06T13:48:13.642 DEBUG:teuthology.orchestra.run.smithi202:> stat /dev/vg_nvme/lv_4 2023-03-06T13:48:13.699 INFO:teuthology.orchestra.run.smithi202.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-03-06T13:48:13.699 INFO:teuthology.orchestra.run.smithi202.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-03-06T13:48:13.699 INFO:teuthology.orchestra.run.smithi202.stdout:Device: 6h/6d Inode: 354251 Links: 1 2023-03-06T13:48:13.699 INFO:teuthology.orchestra.run.smithi202.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-03-06T13:48:13.699 INFO:teuthology.orchestra.run.smithi202.stdout:Context: system_u:object_r:device_t:s0 2023-03-06T13:48:13.700 INFO:teuthology.orchestra.run.smithi202.stdout:Access: 2023-03-06 13:48:04.314137938 +0000 2023-03-06T13:48:13.700 INFO:teuthology.orchestra.run.smithi202.stdout:Modify: 2023-03-06 13:45:30.715245932 +0000 2023-03-06T13:48:13.700 INFO:teuthology.orchestra.run.smithi202.stdout:Change: 2023-03-06 13:45:30.715245932 +0000 2023-03-06T13:48:13.700 INFO:teuthology.orchestra.run.smithi202.stdout: Birth: - 2023-03-06T13:48:13.700 DEBUG:teuthology.orchestra.run.smithi202:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-03-06T13:48:13.764 INFO:teuthology.orchestra.run.smithi202.stderr:1+0 records in 2023-03-06T13:48:13.764 INFO:teuthology.orchestra.run.smithi202.stderr:1+0 records out 2023-03-06T13:48:13.764 INFO:teuthology.orchestra.run.smithi202.stderr:512 bytes copied, 0.000194587 s, 2.6 MB/s 2023-03-06T13:48:13.765 DEBUG:teuthology.orchestra.run.smithi202:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-03-06T13:48:13.822 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-03-06T13:48:13.823 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi086.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi202.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-03-06T13:48:13.823 INFO:tasks.ceph:Generating config... 2023-03-06T13:48:13.824 INFO:tasks.ceph:[client] client mount timeout = 600 2023-03-06T13:48:13.825 INFO:tasks.ceph:[client] debug client = 20 2023-03-06T13:48:13.825 INFO:tasks.ceph:[client] debug ms = 1 2023-03-06T13:48:13.825 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-03-06T13:48:13.825 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-03-06T13:48:13.826 INFO:tasks.ceph:[global] ms die on skipped message = False 2023-03-06T13:48:13.826 INFO:tasks.ceph:[mds] debug mds = 20 2023-03-06T13:48:13.826 INFO:tasks.ceph:[mds] debug mds balancer = 20 2023-03-06T13:48:13.826 INFO:tasks.ceph:[mds] debug ms = 1 2023-03-06T13:48:13.826 INFO:tasks.ceph:[mds] mds debug frag = True 2023-03-06T13:48:13.827 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-03-06T13:48:13.827 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-03-06T13:48:13.827 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-03-06T13:48:13.827 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-03-06T13:48:13.827 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-03-06T13:48:13.828 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-03-06T13:48:13.828 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-03-06T13:48:13.828 INFO:tasks.ceph:[mgr] debug ms = 1 2023-03-06T13:48:13.828 INFO:tasks.ceph:[mon] debug mon = 20 2023-03-06T13:48:13.828 INFO:tasks.ceph:[mon] debug ms = 1 2023-03-06T13:48:13.829 INFO:tasks.ceph:[mon] debug paxos = 20 2023-03-06T13:48:13.829 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-03-06T13:48:13.829 INFO:tasks.ceph:[osd] bdev async discard = True 2023-03-06T13:48:13.829 INFO:tasks.ceph:[osd] bdev enable discard = True 2023-03-06T13:48:13.829 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2023-03-06T13:48:13.830 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-03-06T13:48:13.830 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-03-06T13:48:13.830 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2023-03-06T13:48:13.830 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2023-03-06T13:48:13.830 INFO:tasks.ceph:[osd] debug ms = 1 2023-03-06T13:48:13.831 INFO:tasks.ceph:[osd] debug osd = 20 2023-03-06T13:48:13.831 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2023-03-06T13:48:13.831 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-03-06T13:48:13.831 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-03-06T13:48:13.831 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-03-06T13:48:13.832 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-03-06T13:48:13.832 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-03-06T13:48:13.832 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-03-06T13:48:13.832 INFO:tasks.ceph:Setting up mon.a... 2023-03-06T13:48:13.833 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-03-06T13:48:13.895 INFO:teuthology.orchestra.run.smithi086.stdout:creating /etc/ceph/ceph.keyring 2023-03-06T13:48:13.898 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-03-06T13:48:13.944 DEBUG:teuthology.orchestra.run.smithi086:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-03-06T13:48:13.970 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.86'), ('mon.b', '172.21.15.202'), ('mon.c', '[v2:172.21.15.202:3301,v1:172.21.15.202:6790]')] 2023-03-06T13:48:13.970 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.86,172.21.15.202,[v2:172.21.15.202:3301,v1:172.21.15.202:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-03-06T13:48:13.971 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2023-03-06T13:48:13.972 DEBUG:teuthology.orchestra.run.smithi086:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-03-06T13:48:14.026 DEBUG:teuthology.orchestra.run.smithi086:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.86 --add b 172.21.15.202 --addv c '[v2:172.21.15.202:3301,v1:172.21.15.202:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-03-06T13:48:14.113 INFO:teuthology.orchestra.run.smithi086.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-03-06T13:48:14.114 INFO:teuthology.orchestra.run.smithi086.stdout:monmaptool: generated fsid 2cca6c77-50cb-47d8-a8c7-444575d01327 2023-03-06T13:48:14.114 INFO:teuthology.orchestra.run.smithi086.stdout:setting min_mon_release = pacific 2023-03-06T13:48:14.114 INFO:teuthology.orchestra.run.smithi086.stdout:epoch 0 2023-03-06T13:48:14.114 INFO:teuthology.orchestra.run.smithi086.stdout:fsid 2cca6c77-50cb-47d8-a8c7-444575d01327 2023-03-06T13:48:14.114 INFO:teuthology.orchestra.run.smithi086.stdout:last_changed 2023-03-06T13:48:14.113413+0000 2023-03-06T13:48:14.115 INFO:teuthology.orchestra.run.smithi086.stdout:created 2023-03-06T13:48:14.113413+0000 2023-03-06T13:48:14.115 INFO:teuthology.orchestra.run.smithi086.stdout:min_mon_release 16 (pacific) 2023-03-06T13:48:14.115 INFO:teuthology.orchestra.run.smithi086.stdout:election_strategy: 1 2023-03-06T13:48:14.115 INFO:teuthology.orchestra.run.smithi086.stdout:0: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.a 2023-03-06T13:48:14.115 INFO:teuthology.orchestra.run.smithi086.stdout:1: [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] mon.b 2023-03-06T13:48:14.115 INFO:teuthology.orchestra.run.smithi086.stdout:2: [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] mon.c 2023-03-06T13:48:14.115 INFO:teuthology.orchestra.run.smithi086.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-03-06T13:48:14.116 DEBUG:teuthology.orchestra.run.smithi086:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-03-06T13:48:14.133 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 2cca6c77-50cb-47d8-a8c7-444575d01327... 2023-03-06T13:48:14.134 DEBUG:teuthology.orchestra.run.smithi086:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-03-06T13:48:14.176 DEBUG:teuthology.orchestra.run.smithi202:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-03-06T13:48:14.218 INFO:teuthology.orchestra.run.smithi086.stdout:[global] 2023-03-06T13:48:14.218 INFO:teuthology.orchestra.run.smithi086.stdout: chdir = "" 2023-03-06T13:48:14.219 INFO:teuthology.orchestra.run.smithi086.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-03-06T13:48:14.219 INFO:teuthology.orchestra.run.smithi086.stdout: auth supported = cephx 2023-03-06T13:48:14.219 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-03-06T13:48:14.220 INFO:teuthology.orchestra.run.smithi086.stdout: filestore xattr use omap = true 2023-03-06T13:48:14.220 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-03-06T13:48:14.220 INFO:teuthology.orchestra.run.smithi086.stdout: mon clock drift allowed = 1.000 2023-03-06T13:48:14.220 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-03-06T13:48:14.221 INFO:teuthology.orchestra.run.smithi086.stdout: osd crush chooseleaf type = 0 2023-03-06T13:48:14.221 INFO:teuthology.orchestra.run.smithi086.stdout: auth debug = true 2023-03-06T13:48:14.221 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-03-06T13:48:14.222 INFO:teuthology.orchestra.run.smithi086.stdout: ms die on old message = true 2023-03-06T13:48:14.222 INFO:teuthology.orchestra.run.smithi086.stdout: ms die on bug = true 2023-03-06T13:48:14.222 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-03-06T13:48:14.222 INFO:teuthology.orchestra.run.smithi086.stdout: mon max pg per osd = 10000 # >= luminous 2023-03-06T13:48:14.223 INFO:teuthology.orchestra.run.smithi086.stdout: mon pg warn max object skew = 0 2023-03-06T13:48:14.223 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-03-06T13:48:14.223 INFO:teuthology.orchestra.run.smithi086.stdout: # disable pg_autoscaler by default for new pools 2023-03-06T13:48:14.223 INFO:teuthology.orchestra.run.smithi086.stdout: osd_pool_default_pg_autoscale_mode = off 2023-03-06T13:48:14.224 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-03-06T13:48:14.224 INFO:teuthology.orchestra.run.smithi086.stdout: osd pool default size = 2 2023-03-06T13:48:14.224 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-03-06T13:48:14.224 INFO:teuthology.orchestra.run.smithi086.stdout: mon osd allow primary affinity = true 2023-03-06T13:48:14.224 INFO:teuthology.orchestra.run.smithi086.stdout: mon osd allow pg remap = true 2023-03-06T13:48:14.225 INFO:teuthology.orchestra.run.smithi086.stdout: mon warn on legacy crush tunables = false 2023-03-06T13:48:14.225 INFO:teuthology.orchestra.run.smithi086.stdout: mon warn on crush straw calc version zero = false 2023-03-06T13:48:14.225 INFO:teuthology.orchestra.run.smithi086.stdout: mon warn on no sortbitwise = false 2023-03-06T13:48:14.225 INFO:teuthology.orchestra.run.smithi086.stdout: mon warn on osd down out interval zero = false 2023-03-06T13:48:14.226 INFO:teuthology.orchestra.run.smithi086.stdout: mon warn on too few osds = false 2023-03-06T13:48:14.226 INFO:teuthology.orchestra.run.smithi086.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-03-06T13:48:14.226 INFO:teuthology.orchestra.run.smithi086.stdout: mon_warn_on_pool_no_redundancy = false 2023-03-06T13:48:14.226 INFO:teuthology.orchestra.run.smithi086.stdout: mon_allow_pool_size_one = true 2023-03-06T13:48:14.227 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-03-06T13:48:14.227 INFO:teuthology.orchestra.run.smithi086.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-03-06T13:48:14.227 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-03-06T13:48:14.227 INFO:teuthology.orchestra.run.smithi086.stdout: osd default data pool replay window = 5 2023-03-06T13:48:14.228 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-03-06T13:48:14.228 INFO:teuthology.orchestra.run.smithi086.stdout: mon allow pool delete = true 2023-03-06T13:48:14.228 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-03-06T13:48:14.228 INFO:teuthology.orchestra.run.smithi086.stdout: mon cluster log file level = debug 2023-03-06T13:48:14.229 INFO:teuthology.orchestra.run.smithi086.stdout: debug asserts on shutdown = true 2023-03-06T13:48:14.229 INFO:teuthology.orchestra.run.smithi086.stdout: mon health detail to clog = false 2023-03-06T13:48:14.229 INFO:teuthology.orchestra.run.smithi086.stdout: mon host = "172.21.15.86,172.21.15.202,[v2:172.21.15.202:3301,v1:172.21.15.202:6790]" 2023-03-06T13:48:14.229 INFO:teuthology.orchestra.run.smithi086.stdout: ms die on skipped message = False 2023-03-06T13:48:14.230 INFO:teuthology.orchestra.run.smithi086.stdout: fsid = 2cca6c77-50cb-47d8-a8c7-444575d01327 2023-03-06T13:48:14.230 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-03-06T13:48:14.230 INFO:teuthology.orchestra.run.smithi086.stdout:[osd] 2023-03-06T13:48:14.230 INFO:teuthology.orchestra.run.smithi086.stdout: osd journal size = 100 2023-03-06T13:48:14.231 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-03-06T13:48:14.231 INFO:teuthology.orchestra.run.smithi086.stdout: osd scrub load threshold = 5.0 2023-03-06T13:48:14.231 INFO:teuthology.orchestra.run.smithi086.stdout: osd scrub max interval = 600 2023-03-06T13:48:14.231 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-03-06T13:48:14.232 INFO:teuthology.orchestra.run.smithi086.stdout: osd recover clone overlap = true 2023-03-06T13:48:14.232 INFO:teuthology.orchestra.run.smithi086.stdout: osd recovery max chunk = 1048576 2023-03-06T13:48:14.232 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-03-06T13:48:14.233 INFO:teuthology.orchestra.run.smithi086.stdout: osd debug shutdown = true 2023-03-06T13:48:14.233 INFO:teuthology.orchestra.run.smithi086.stdout: osd debug op order = true 2023-03-06T13:48:14.233 INFO:teuthology.orchestra.run.smithi086.stdout: osd debug verify stray on activate = true 2023-03-06T13:48:14.233 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-03-06T13:48:14.234 INFO:teuthology.orchestra.run.smithi086.stdout: osd open classes on start = true 2023-03-06T13:48:14.234 INFO:teuthology.orchestra.run.smithi086.stdout: osd debug pg log writeout = true 2023-03-06T13:48:14.234 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-03-06T13:48:14.234 INFO:teuthology.orchestra.run.smithi086.stdout: osd deep scrub update digest min age = 30 2023-03-06T13:48:14.235 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-03-06T13:48:14.235 INFO:teuthology.orchestra.run.smithi086.stdout: osd map max advance = 10 2023-03-06T13:48:14.235 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-03-06T13:48:14.235 INFO:teuthology.orchestra.run.smithi086.stdout: journal zero on create = true 2023-03-06T13:48:14.236 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-03-06T13:48:14.236 INFO:teuthology.orchestra.run.smithi086.stdout: filestore ondisk finisher threads = 3 2023-03-06T13:48:14.236 INFO:teuthology.orchestra.run.smithi086.stdout: filestore apply finisher threads = 3 2023-03-06T13:48:14.236 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-03-06T13:48:14.237 INFO:teuthology.orchestra.run.smithi086.stdout: bdev debug aio = true 2023-03-06T13:48:14.237 INFO:teuthology.orchestra.run.smithi086.stdout: osd debug misdirected ops = true 2023-03-06T13:48:14.237 INFO:teuthology.orchestra.run.smithi086.stdout: bdev async discard = True 2023-03-06T13:48:14.237 INFO:teuthology.orchestra.run.smithi086.stdout: bdev enable discard = True 2023-03-06T13:48:14.238 INFO:teuthology.orchestra.run.smithi086.stdout: bluestore allocator = bitmap 2023-03-06T13:48:14.238 INFO:teuthology.orchestra.run.smithi086.stdout: bluestore block size = 96636764160 2023-03-06T13:48:14.238 INFO:teuthology.orchestra.run.smithi086.stdout: bluestore fsck on mount = True 2023-03-06T13:48:14.238 INFO:teuthology.orchestra.run.smithi086.stdout: debug bluefs = 1/20 2023-03-06T13:48:14.239 INFO:teuthology.orchestra.run.smithi086.stdout: debug bluestore = 1/20 2023-03-06T13:48:14.239 INFO:teuthology.orchestra.run.smithi086.stdout: debug ms = 1 2023-03-06T13:48:14.239 INFO:teuthology.orchestra.run.smithi086.stdout: debug osd = 20 2023-03-06T13:48:14.239 INFO:teuthology.orchestra.run.smithi086.stdout: debug rocksdb = 4/10 2023-03-06T13:48:14.240 INFO:teuthology.orchestra.run.smithi086.stdout: mon osd backfillfull_ratio = 0.85 2023-03-06T13:48:14.240 INFO:teuthology.orchestra.run.smithi086.stdout: mon osd full ratio = 0.9 2023-03-06T13:48:14.240 INFO:teuthology.orchestra.run.smithi086.stdout: mon osd nearfull ratio = 0.8 2023-03-06T13:48:14.240 INFO:teuthology.orchestra.run.smithi086.stdout: osd failsafe full ratio = 0.95 2023-03-06T13:48:14.241 INFO:teuthology.orchestra.run.smithi086.stdout: osd objectstore = bluestore 2023-03-06T13:48:14.241 INFO:teuthology.orchestra.run.smithi086.stdout: osd op complaint time = 180 2023-03-06T13:48:14.241 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-03-06T13:48:14.241 INFO:teuthology.orchestra.run.smithi086.stdout:[mgr] 2023-03-06T13:48:14.242 INFO:teuthology.orchestra.run.smithi086.stdout: debug ms = 1 2023-03-06T13:48:14.242 INFO:teuthology.orchestra.run.smithi086.stdout: debug mgr = 20 2023-03-06T13:48:14.242 INFO:teuthology.orchestra.run.smithi086.stdout: debug mon = 20 2023-03-06T13:48:14.242 INFO:teuthology.orchestra.run.smithi086.stdout: debug auth = 20 2023-03-06T13:48:14.243 INFO:teuthology.orchestra.run.smithi086.stdout: mon reweight min pgs per osd = 4 2023-03-06T13:48:14.243 INFO:teuthology.orchestra.run.smithi086.stdout: mon reweight min bytes per osd = 10 2023-03-06T13:48:14.243 INFO:teuthology.orchestra.run.smithi086.stdout: mgr/telemetry/nag = false 2023-03-06T13:48:14.243 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-03-06T13:48:14.243 INFO:teuthology.orchestra.run.smithi086.stdout:[mon] 2023-03-06T13:48:14.244 INFO:teuthology.orchestra.run.smithi086.stdout: debug ms = 1 2023-03-06T13:48:14.244 INFO:teuthology.orchestra.run.smithi086.stdout: debug mon = 20 2023-03-06T13:48:14.244 INFO:teuthology.orchestra.run.smithi086.stdout: debug paxos = 20 2023-03-06T13:48:14.244 INFO:teuthology.orchestra.run.smithi086.stdout: debug auth = 20 2023-03-06T13:48:14.245 INFO:teuthology.orchestra.run.smithi086.stdout: mon data avail warn = 5 2023-03-06T13:48:14.245 INFO:teuthology.orchestra.run.smithi086.stdout: mon mgr mkfs grace = 240 2023-03-06T13:48:14.245 INFO:teuthology.orchestra.run.smithi086.stdout: mon reweight min pgs per osd = 4 2023-03-06T13:48:14.246 INFO:teuthology.orchestra.run.smithi086.stdout: mon osd reporter subtree level = osd 2023-03-06T13:48:14.246 INFO:teuthology.orchestra.run.smithi086.stdout: mon osd prime pg temp = true 2023-03-06T13:48:14.246 INFO:teuthology.orchestra.run.smithi086.stdout: mon reweight min bytes per osd = 10 2023-03-06T13:48:14.246 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-03-06T13:48:14.247 INFO:teuthology.orchestra.run.smithi086.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-03-06T13:48:14.247 INFO:teuthology.orchestra.run.smithi086.stdout: auth mon ticket ttl = 660 # 11m 2023-03-06T13:48:14.247 INFO:teuthology.orchestra.run.smithi086.stdout: auth service ticket ttl = 240 # 4m 2023-03-06T13:48:14.247 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-03-06T13:48:14.248 INFO:teuthology.orchestra.run.smithi086.stdout: # don't complain about insecure global_id in the test suite 2023-03-06T13:48:14.248 INFO:teuthology.orchestra.run.smithi086.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-03-06T13:48:14.248 INFO:teuthology.orchestra.run.smithi086.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-03-06T13:48:14.248 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-03-06T13:48:14.249 INFO:teuthology.orchestra.run.smithi086.stdout: # 1m isn't quite enough 2023-03-06T13:48:14.249 INFO:teuthology.orchestra.run.smithi086.stdout: mon_down_mkfs_grace = 2m 2023-03-06T13:48:14.249 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-03-06T13:48:14.250 INFO:teuthology.orchestra.run.smithi086.stdout: mon_warn_on_filestore_osds = false 2023-03-06T13:48:14.250 INFO:teuthology.orchestra.run.smithi086.stdout: mon op complaint time = 120 2023-03-06T13:48:14.250 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-03-06T13:48:14.250 INFO:teuthology.orchestra.run.smithi086.stdout:[client] 2023-03-06T13:48:14.251 INFO:teuthology.orchestra.run.smithi086.stdout: rgw cache enabled = true 2023-03-06T13:48:14.251 INFO:teuthology.orchestra.run.smithi086.stdout: rgw enable ops log = true 2023-03-06T13:48:14.252 INFO:teuthology.orchestra.run.smithi086.stdout: rgw enable usage log = true 2023-03-06T13:48:14.252 INFO:teuthology.orchestra.run.smithi086.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-03-06T13:48:14.252 INFO:teuthology.orchestra.run.smithi086.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-03-06T13:48:14.252 INFO:teuthology.orchestra.run.smithi086.stdout: client mount timeout = 600 2023-03-06T13:48:14.253 INFO:teuthology.orchestra.run.smithi086.stdout: debug client = 20 2023-03-06T13:48:14.253 INFO:teuthology.orchestra.run.smithi086.stdout: debug ms = 1 2023-03-06T13:48:14.253 INFO:teuthology.orchestra.run.smithi086.stdout: rados mon op timeout = 900 2023-03-06T13:48:14.253 INFO:teuthology.orchestra.run.smithi086.stdout: rados osd op timeout = 900 2023-03-06T13:48:14.254 INFO:teuthology.orchestra.run.smithi086.stdout:[mon.a] 2023-03-06T13:48:14.254 INFO:teuthology.orchestra.run.smithi086.stdout:[mon.b] 2023-03-06T13:48:14.254 INFO:teuthology.orchestra.run.smithi086.stdout:[mon.c] 2023-03-06T13:48:14.255 INFO:teuthology.orchestra.run.smithi086.stdout:[mds.a] 2023-03-06T13:48:14.255 INFO:teuthology.orchestra.run.smithi086.stdout:[mds.c] 2023-03-06T13:48:14.255 INFO:teuthology.orchestra.run.smithi086.stdout:[mds.b] 2023-03-06T13:48:14.255 INFO:teuthology.orchestra.run.smithi086.stdout:[mds.d] 2023-03-06T13:48:14.255 INFO:teuthology.orchestra.run.smithi086.stdout:[mds] 2023-03-06T13:48:14.256 INFO:teuthology.orchestra.run.smithi086.stdout: debug mds = 20 2023-03-06T13:48:14.256 INFO:teuthology.orchestra.run.smithi086.stdout: debug mds balancer = 20 2023-03-06T13:48:14.256 INFO:teuthology.orchestra.run.smithi086.stdout: debug ms = 1 2023-03-06T13:48:14.256 INFO:teuthology.orchestra.run.smithi086.stdout: mds debug frag = True 2023-03-06T13:48:14.257 INFO:teuthology.orchestra.run.smithi086.stdout: mds debug scatterstat = True 2023-03-06T13:48:14.257 INFO:teuthology.orchestra.run.smithi086.stdout: mds op complaint time = 180 2023-03-06T13:48:14.257 INFO:teuthology.orchestra.run.smithi086.stdout: mds verify scatter = True 2023-03-06T13:48:14.257 INFO:teuthology.orchestra.run.smithi086.stdout: osd op complaint time = 180 2023-03-06T13:48:14.258 INFO:teuthology.orchestra.run.smithi086.stdout: rados mon op timeout = 900 2023-03-06T13:48:14.258 INFO:teuthology.orchestra.run.smithi086.stdout: rados osd op timeout = 900 2023-03-06T13:48:14.260 INFO:teuthology.orchestra.run.smithi202.stdout:[global] 2023-03-06T13:48:14.260 INFO:teuthology.orchestra.run.smithi202.stdout: chdir = "" 2023-03-06T13:48:14.261 INFO:teuthology.orchestra.run.smithi202.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-03-06T13:48:14.261 INFO:teuthology.orchestra.run.smithi202.stdout: auth supported = cephx 2023-03-06T13:48:14.261 INFO:teuthology.orchestra.run.smithi202.stdout: 2023-03-06T13:48:14.261 INFO:teuthology.orchestra.run.smithi202.stdout: filestore xattr use omap = true 2023-03-06T13:48:14.262 INFO:teuthology.orchestra.run.smithi202.stdout: 2023-03-06T13:48:14.262 INFO:teuthology.orchestra.run.smithi202.stdout: mon clock drift allowed = 1.000 2023-03-06T13:48:14.262 INFO:teuthology.orchestra.run.smithi202.stdout: 2023-03-06T13:48:14.262 INFO:teuthology.orchestra.run.smithi202.stdout: osd crush chooseleaf type = 0 2023-03-06T13:48:14.263 INFO:teuthology.orchestra.run.smithi202.stdout: auth debug = true 2023-03-06T13:48:14.263 INFO:teuthology.orchestra.run.smithi202.stdout: 2023-03-06T13:48:14.263 INFO:teuthology.orchestra.run.smithi202.stdout: ms die on old message = true 2023-03-06T13:48:14.263 INFO:teuthology.orchestra.run.smithi202.stdout: ms die on bug = true 2023-03-06T13:48:14.264 INFO:teuthology.orchestra.run.smithi202.stdout: 2023-03-06T13:48:14.264 INFO:teuthology.orchestra.run.smithi202.stdout: mon max pg per osd = 10000 # >= luminous 2023-03-06T13:48:14.264 INFO:teuthology.orchestra.run.smithi202.stdout: mon pg warn max object skew = 0 2023-03-06T13:48:14.264 INFO:teuthology.orchestra.run.smithi202.stdout: 2023-03-06T13:48:14.264 INFO:teuthology.orchestra.run.smithi202.stdout: # disable pg_autoscaler by default for new pools 2023-03-06T13:48:14.265 INFO:teuthology.orchestra.run.smithi202.stdout: osd_pool_default_pg_autoscale_mode = off 2023-03-06T13:48:14.265 INFO:teuthology.orchestra.run.smithi202.stdout: 2023-03-06T13:48:14.265 INFO:teuthology.orchestra.run.smithi202.stdout: osd pool default size = 2 2023-03-06T13:48:14.265 INFO:teuthology.orchestra.run.smithi202.stdout: 2023-03-06T13:48:14.265 INFO:teuthology.orchestra.run.smithi202.stdout: mon osd allow primary affinity = true 2023-03-06T13:48:14.266 INFO:teuthology.orchestra.run.smithi202.stdout: mon osd allow pg remap = true 2023-03-06T13:48:14.266 INFO:teuthology.orchestra.run.smithi202.stdout: mon warn on legacy crush tunables = false 2023-03-06T13:48:14.266 INFO:teuthology.orchestra.run.smithi202.stdout: mon warn on crush straw calc version zero = false 2023-03-06T13:48:14.266 INFO:teuthology.orchestra.run.smithi202.stdout: mon warn on no sortbitwise = false 2023-03-06T13:48:14.266 INFO:teuthology.orchestra.run.smithi202.stdout: mon warn on osd down out interval zero = false 2023-03-06T13:48:14.266 INFO:teuthology.orchestra.run.smithi202.stdout: mon warn on too few osds = false 2023-03-06T13:48:14.266 INFO:teuthology.orchestra.run.smithi202.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-03-06T13:48:14.267 INFO:teuthology.orchestra.run.smithi202.stdout: mon_warn_on_pool_no_redundancy = false 2023-03-06T13:48:14.267 INFO:teuthology.orchestra.run.smithi202.stdout: mon_allow_pool_size_one = true 2023-03-06T13:48:14.267 INFO:teuthology.orchestra.run.smithi202.stdout: 2023-03-06T13:48:14.267 INFO:teuthology.orchestra.run.smithi202.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-03-06T13:48:14.267 INFO:teuthology.orchestra.run.smithi202.stdout: 2023-03-06T13:48:14.267 INFO:teuthology.orchestra.run.smithi202.stdout: osd default data pool replay window = 5 2023-03-06T13:48:14.268 INFO:teuthology.orchestra.run.smithi202.stdout: 2023-03-06T13:48:14.268 INFO:teuthology.orchestra.run.smithi202.stdout: mon allow pool delete = true 2023-03-06T13:48:14.268 INFO:teuthology.orchestra.run.smithi202.stdout: 2023-03-06T13:48:14.268 INFO:teuthology.orchestra.run.smithi202.stdout: mon cluster log file level = debug 2023-03-06T13:48:14.268 INFO:teuthology.orchestra.run.smithi202.stdout: debug asserts on shutdown = true 2023-03-06T13:48:14.268 INFO:teuthology.orchestra.run.smithi202.stdout: mon health detail to clog = false 2023-03-06T13:48:14.268 INFO:teuthology.orchestra.run.smithi202.stdout: mon host = "172.21.15.86,172.21.15.202,[v2:172.21.15.202:3301,v1:172.21.15.202:6790]" 2023-03-06T13:48:14.268 INFO:teuthology.orchestra.run.smithi202.stdout: ms die on skipped message = False 2023-03-06T13:48:14.269 INFO:teuthology.orchestra.run.smithi202.stdout: fsid = 2cca6c77-50cb-47d8-a8c7-444575d01327 2023-03-06T13:48:14.269 INFO:teuthology.orchestra.run.smithi202.stdout: 2023-03-06T13:48:14.269 INFO:teuthology.orchestra.run.smithi202.stdout:[osd] 2023-03-06T13:48:14.269 INFO:teuthology.orchestra.run.smithi202.stdout: osd journal size = 100 2023-03-06T13:48:14.269 INFO:teuthology.orchestra.run.smithi202.stdout: 2023-03-06T13:48:14.269 INFO:teuthology.orchestra.run.smithi202.stdout: osd scrub load threshold = 5.0 2023-03-06T13:48:14.269 INFO:teuthology.orchestra.run.smithi202.stdout: osd scrub max interval = 600 2023-03-06T13:48:14.270 INFO:teuthology.orchestra.run.smithi202.stdout: 2023-03-06T13:48:14.270 INFO:teuthology.orchestra.run.smithi202.stdout: osd recover clone overlap = true 2023-03-06T13:48:14.270 INFO:teuthology.orchestra.run.smithi202.stdout: osd recovery max chunk = 1048576 2023-03-06T13:48:14.270 INFO:teuthology.orchestra.run.smithi202.stdout: 2023-03-06T13:48:14.270 INFO:teuthology.orchestra.run.smithi202.stdout: osd debug shutdown = true 2023-03-06T13:48:14.270 INFO:teuthology.orchestra.run.smithi202.stdout: osd debug op order = true 2023-03-06T13:48:14.270 INFO:teuthology.orchestra.run.smithi202.stdout: osd debug verify stray on activate = true 2023-03-06T13:48:14.270 INFO:teuthology.orchestra.run.smithi202.stdout: 2023-03-06T13:48:14.271 INFO:teuthology.orchestra.run.smithi202.stdout: osd open classes on start = true 2023-03-06T13:48:14.271 INFO:teuthology.orchestra.run.smithi202.stdout: osd debug pg log writeout = true 2023-03-06T13:48:14.271 INFO:teuthology.orchestra.run.smithi202.stdout: 2023-03-06T13:48:14.271 INFO:teuthology.orchestra.run.smithi202.stdout: osd deep scrub update digest min age = 30 2023-03-06T13:48:14.271 INFO:teuthology.orchestra.run.smithi202.stdout: 2023-03-06T13:48:14.271 INFO:teuthology.orchestra.run.smithi202.stdout: osd map max advance = 10 2023-03-06T13:48:14.271 INFO:teuthology.orchestra.run.smithi202.stdout: 2023-03-06T13:48:14.272 INFO:teuthology.orchestra.run.smithi202.stdout: journal zero on create = true 2023-03-06T13:48:14.272 INFO:teuthology.orchestra.run.smithi202.stdout: 2023-03-06T13:48:14.272 INFO:teuthology.orchestra.run.smithi202.stdout: filestore ondisk finisher threads = 3 2023-03-06T13:48:14.272 INFO:teuthology.orchestra.run.smithi202.stdout: filestore apply finisher threads = 3 2023-03-06T13:48:14.272 INFO:teuthology.orchestra.run.smithi202.stdout: 2023-03-06T13:48:14.272 INFO:teuthology.orchestra.run.smithi202.stdout: bdev debug aio = true 2023-03-06T13:48:14.272 INFO:teuthology.orchestra.run.smithi202.stdout: osd debug misdirected ops = true 2023-03-06T13:48:14.272 INFO:teuthology.orchestra.run.smithi202.stdout: bdev async discard = True 2023-03-06T13:48:14.273 INFO:teuthology.orchestra.run.smithi202.stdout: bdev enable discard = True 2023-03-06T13:48:14.273 INFO:teuthology.orchestra.run.smithi202.stdout: bluestore allocator = bitmap 2023-03-06T13:48:14.273 INFO:teuthology.orchestra.run.smithi202.stdout: bluestore block size = 96636764160 2023-03-06T13:48:14.273 INFO:teuthology.orchestra.run.smithi202.stdout: bluestore fsck on mount = True 2023-03-06T13:48:14.273 INFO:teuthology.orchestra.run.smithi202.stdout: debug bluefs = 1/20 2023-03-06T13:48:14.273 INFO:teuthology.orchestra.run.smithi202.stdout: debug bluestore = 1/20 2023-03-06T13:48:14.273 INFO:teuthology.orchestra.run.smithi202.stdout: debug ms = 1 2023-03-06T13:48:14.274 INFO:teuthology.orchestra.run.smithi202.stdout: debug osd = 20 2023-03-06T13:48:14.274 INFO:teuthology.orchestra.run.smithi202.stdout: debug rocksdb = 4/10 2023-03-06T13:48:14.274 INFO:teuthology.orchestra.run.smithi202.stdout: mon osd backfillfull_ratio = 0.85 2023-03-06T13:48:14.274 INFO:teuthology.orchestra.run.smithi202.stdout: mon osd full ratio = 0.9 2023-03-06T13:48:14.274 INFO:teuthology.orchestra.run.smithi202.stdout: mon osd nearfull ratio = 0.8 2023-03-06T13:48:14.274 INFO:teuthology.orchestra.run.smithi202.stdout: osd failsafe full ratio = 0.95 2023-03-06T13:48:14.274 INFO:teuthology.orchestra.run.smithi202.stdout: osd objectstore = bluestore 2023-03-06T13:48:14.274 INFO:teuthology.orchestra.run.smithi202.stdout: osd op complaint time = 180 2023-03-06T13:48:14.275 INFO:teuthology.orchestra.run.smithi202.stdout: 2023-03-06T13:48:14.275 INFO:teuthology.orchestra.run.smithi202.stdout:[mgr] 2023-03-06T13:48:14.275 INFO:teuthology.orchestra.run.smithi202.stdout: debug ms = 1 2023-03-06T13:48:14.275 INFO:teuthology.orchestra.run.smithi202.stdout: debug mgr = 20 2023-03-06T13:48:14.275 INFO:teuthology.orchestra.run.smithi202.stdout: debug mon = 20 2023-03-06T13:48:14.275 INFO:teuthology.orchestra.run.smithi202.stdout: debug auth = 20 2023-03-06T13:48:14.275 INFO:teuthology.orchestra.run.smithi202.stdout: mon reweight min pgs per osd = 4 2023-03-06T13:48:14.275 INFO:teuthology.orchestra.run.smithi202.stdout: mon reweight min bytes per osd = 10 2023-03-06T13:48:14.276 INFO:teuthology.orchestra.run.smithi202.stdout: mgr/telemetry/nag = false 2023-03-06T13:48:14.276 INFO:teuthology.orchestra.run.smithi202.stdout: 2023-03-06T13:48:14.276 INFO:teuthology.orchestra.run.smithi202.stdout:[mon] 2023-03-06T13:48:14.276 INFO:teuthology.orchestra.run.smithi202.stdout: debug ms = 1 2023-03-06T13:48:14.276 INFO:teuthology.orchestra.run.smithi202.stdout: debug mon = 20 2023-03-06T13:48:14.276 INFO:teuthology.orchestra.run.smithi202.stdout: debug paxos = 20 2023-03-06T13:48:14.276 INFO:teuthology.orchestra.run.smithi202.stdout: debug auth = 20 2023-03-06T13:48:14.276 INFO:teuthology.orchestra.run.smithi202.stdout: mon data avail warn = 5 2023-03-06T13:48:14.277 INFO:teuthology.orchestra.run.smithi202.stdout: mon mgr mkfs grace = 240 2023-03-06T13:48:14.277 INFO:teuthology.orchestra.run.smithi202.stdout: mon reweight min pgs per osd = 4 2023-03-06T13:48:14.277 INFO:teuthology.orchestra.run.smithi202.stdout: mon osd reporter subtree level = osd 2023-03-06T13:48:14.277 INFO:teuthology.orchestra.run.smithi202.stdout: mon osd prime pg temp = true 2023-03-06T13:48:14.277 INFO:teuthology.orchestra.run.smithi202.stdout: mon reweight min bytes per osd = 10 2023-03-06T13:48:14.277 INFO:teuthology.orchestra.run.smithi202.stdout: 2023-03-06T13:48:14.277 INFO:teuthology.orchestra.run.smithi202.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-03-06T13:48:14.277 INFO:teuthology.orchestra.run.smithi202.stdout: auth mon ticket ttl = 660 # 11m 2023-03-06T13:48:14.278 INFO:teuthology.orchestra.run.smithi202.stdout: auth service ticket ttl = 240 # 4m 2023-03-06T13:48:14.278 INFO:teuthology.orchestra.run.smithi202.stdout: 2023-03-06T13:48:14.278 INFO:teuthology.orchestra.run.smithi202.stdout: # don't complain about insecure global_id in the test suite 2023-03-06T13:48:14.278 INFO:teuthology.orchestra.run.smithi202.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-03-06T13:48:14.278 INFO:teuthology.orchestra.run.smithi202.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-03-06T13:48:14.278 INFO:teuthology.orchestra.run.smithi202.stdout: 2023-03-06T13:48:14.278 INFO:teuthology.orchestra.run.smithi202.stdout: # 1m isn't quite enough 2023-03-06T13:48:14.279 INFO:teuthology.orchestra.run.smithi202.stdout: mon_down_mkfs_grace = 2m 2023-03-06T13:48:14.279 INFO:teuthology.orchestra.run.smithi202.stdout: 2023-03-06T13:48:14.279 INFO:teuthology.orchestra.run.smithi202.stdout: mon_warn_on_filestore_osds = false 2023-03-06T13:48:14.279 INFO:teuthology.orchestra.run.smithi202.stdout: mon op complaint time = 120 2023-03-06T13:48:14.279 INFO:teuthology.orchestra.run.smithi202.stdout: 2023-03-06T13:48:14.279 INFO:teuthology.orchestra.run.smithi202.stdout:[client] 2023-03-06T13:48:14.279 INFO:teuthology.orchestra.run.smithi202.stdout: rgw cache enabled = true 2023-03-06T13:48:14.279 INFO:teuthology.orchestra.run.smithi202.stdout: rgw enable ops log = true 2023-03-06T13:48:14.280 INFO:teuthology.orchestra.run.smithi202.stdout: rgw enable usage log = true 2023-03-06T13:48:14.280 INFO:teuthology.orchestra.run.smithi202.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-03-06T13:48:14.280 INFO:teuthology.orchestra.run.smithi202.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-03-06T13:48:14.280 INFO:teuthology.orchestra.run.smithi202.stdout: client mount timeout = 600 2023-03-06T13:48:14.280 INFO:teuthology.orchestra.run.smithi202.stdout: debug client = 20 2023-03-06T13:48:14.280 INFO:teuthology.orchestra.run.smithi202.stdout: debug ms = 1 2023-03-06T13:48:14.280 INFO:teuthology.orchestra.run.smithi202.stdout: rados mon op timeout = 900 2023-03-06T13:48:14.280 INFO:teuthology.orchestra.run.smithi202.stdout: rados osd op timeout = 900 2023-03-06T13:48:14.281 INFO:teuthology.orchestra.run.smithi202.stdout:[mon.a] 2023-03-06T13:48:14.281 INFO:teuthology.orchestra.run.smithi202.stdout:[mon.b] 2023-03-06T13:48:14.281 INFO:teuthology.orchestra.run.smithi202.stdout:[mon.c] 2023-03-06T13:48:14.281 INFO:teuthology.orchestra.run.smithi202.stdout:[mds.a] 2023-03-06T13:48:14.281 INFO:teuthology.orchestra.run.smithi202.stdout:[mds.c] 2023-03-06T13:48:14.281 INFO:teuthology.orchestra.run.smithi202.stdout:[mds.b] 2023-03-06T13:48:14.281 INFO:teuthology.orchestra.run.smithi202.stdout:[mds.d] 2023-03-06T13:48:14.281 INFO:teuthology.orchestra.run.smithi202.stdout:[mds] 2023-03-06T13:48:14.282 INFO:teuthology.orchestra.run.smithi202.stdout: debug mds = 20 2023-03-06T13:48:14.282 INFO:teuthology.orchestra.run.smithi202.stdout: debug mds balancer = 20 2023-03-06T13:48:14.282 INFO:teuthology.orchestra.run.smithi202.stdout: debug ms = 1 2023-03-06T13:48:14.282 INFO:teuthology.orchestra.run.smithi202.stdout: mds debug frag = True 2023-03-06T13:48:14.282 INFO:teuthology.orchestra.run.smithi202.stdout: mds debug scatterstat = True 2023-03-06T13:48:14.282 INFO:teuthology.orchestra.run.smithi202.stdout: mds op complaint time = 180 2023-03-06T13:48:14.282 INFO:teuthology.orchestra.run.smithi202.stdout: mds verify scatter = True 2023-03-06T13:48:14.282 INFO:teuthology.orchestra.run.smithi202.stdout: osd op complaint time = 180 2023-03-06T13:48:14.283 INFO:teuthology.orchestra.run.smithi202.stdout: rados mon op timeout = 900 2023-03-06T13:48:14.283 INFO:teuthology.orchestra.run.smithi202.stdout: rados osd op timeout = 900 2023-03-06T13:48:14.283 INFO:tasks.ceph:Creating admin key on mon.a... 2023-03-06T13:48:14.283 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-03-06T13:48:14.357 INFO:tasks.ceph:Copying monmap to all nodes... 2023-03-06T13:48:14.357 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2023-03-06T13:48:14.358 DEBUG:teuthology.orchestra.run.smithi086:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-03-06T13:48:14.374 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2023-03-06T13:48:14.375 DEBUG:teuthology.orchestra.run.smithi086:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-03-06T13:48:14.431 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi086.front.sepia.ceph.com 2023-03-06T13:48:14.432 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2023-03-06T13:48:14.433 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd of=/etc/ceph/ceph.keyring 2023-03-06T13:48:14.433 DEBUG:teuthology.orchestra.run.smithi086:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-03-06T13:48:14.507 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2023-03-06T13:48:14.507 DEBUG:teuthology.orchestra.run.smithi086:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-03-06T13:48:14.564 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi202.front.sepia.ceph.com 2023-03-06T13:48:14.565 DEBUG:teuthology.orchestra.run.smithi202:> set -ex 2023-03-06T13:48:14.566 DEBUG:teuthology.orchestra.run.smithi202:> sudo dd of=/etc/ceph/ceph.keyring 2023-03-06T13:48:14.566 DEBUG:teuthology.orchestra.run.smithi202:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-03-06T13:48:14.606 DEBUG:teuthology.orchestra.run.smithi202:> set -ex 2023-03-06T13:48:14.607 DEBUG:teuthology.orchestra.run.smithi202:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-03-06T13:48:14.663 INFO:tasks.ceph:Setting up mon nodes... 2023-03-06T13:48:14.664 INFO:tasks.ceph:Setting up mgr nodes... 2023-03-06T13:48:14.664 DEBUG:teuthology.orchestra.run.smithi086:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-03-06T13:48:14.716 INFO:teuthology.orchestra.run.smithi086.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-03-06T13:48:14.719 DEBUG:teuthology.orchestra.run.smithi202:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-03-06T13:48:14.796 INFO:teuthology.orchestra.run.smithi202.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-03-06T13:48:14.799 INFO:tasks.ceph:Setting up mds nodes... 2023-03-06T13:48:14.800 DEBUG:teuthology.orchestra.run.smithi086:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-03-06T13:48:14.854 INFO:teuthology.orchestra.run.smithi086.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-03-06T13:48:14.856 DEBUG:teuthology.orchestra.run.smithi086:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-03-06T13:48:14.883 DEBUG:teuthology.orchestra.run.smithi086:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-03-06T13:48:14.976 INFO:teuthology.orchestra.run.smithi086.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-03-06T13:48:14.978 DEBUG:teuthology.orchestra.run.smithi086:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-03-06T13:48:15.004 DEBUG:teuthology.orchestra.run.smithi202:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-03-06T13:48:15.059 INFO:teuthology.orchestra.run.smithi202.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-03-06T13:48:15.061 DEBUG:teuthology.orchestra.run.smithi202:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-03-06T13:48:15.088 DEBUG:teuthology.orchestra.run.smithi202:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2023-03-06T13:48:15.180 INFO:teuthology.orchestra.run.smithi202.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2023-03-06T13:48:15.182 DEBUG:teuthology.orchestra.run.smithi202:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2023-03-06T13:48:15.208 INFO:tasks.ceph_client:Setting up client nodes... 2023-03-06T13:48:15.209 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-03-06T13:48:15.252 INFO:teuthology.orchestra.run.smithi086.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-03-06T13:48:15.264 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-03-06T13:48:15.265 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi086.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi202.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-03-06T13:48:15.265 DEBUG:teuthology.orchestra.run.smithi086:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-03-06T13:48:15.330 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-03-06T13:48:15.331 INFO:tasks.ceph:role: osd.0 2023-03-06T13:48:15.331 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi086.front.sepia.ceph.com 2023-03-06T13:48:15.331 DEBUG:teuthology.orchestra.run.smithi086:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-03-06T13:48:15.404 INFO:teuthology.orchestra.run.smithi086.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-03-06T13:48:15.404 INFO:teuthology.orchestra.run.smithi086.stdout: = sectsz=512 attr=2, projid32bit=1 2023-03-06T13:48:15.404 INFO:teuthology.orchestra.run.smithi086.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-03-06T13:48:15.405 INFO:teuthology.orchestra.run.smithi086.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-03-06T13:48:15.405 INFO:teuthology.orchestra.run.smithi086.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-03-06T13:48:15.405 INFO:teuthology.orchestra.run.smithi086.stdout: = sunit=0 swidth=0 blks 2023-03-06T13:48:15.405 INFO:teuthology.orchestra.run.smithi086.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-03-06T13:48:15.405 INFO:teuthology.orchestra.run.smithi086.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-03-06T13:48:15.405 INFO:teuthology.orchestra.run.smithi086.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-03-06T13:48:15.405 INFO:teuthology.orchestra.run.smithi086.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-03-06T13:48:15.823 INFO:teuthology.orchestra.run.smithi086.stdout:Discarding blocks...Done. 2023-03-06T13:48:15.825 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi086.front.sepia.ceph.com -o noatime 2023-03-06T13:48:15.825 DEBUG:teuthology.orchestra.run.smithi086:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-03-06T13:48:15.977 DEBUG:teuthology.orchestra.run.smithi086:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-03-06T13:48:16.011 DEBUG:teuthology.orchestra.run.smithi086:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-03-06T13:48:16.078 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-03-06T13:48:16.078 INFO:tasks.ceph:role: osd.1 2023-03-06T13:48:16.078 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi086.front.sepia.ceph.com 2023-03-06T13:48:16.078 DEBUG:teuthology.orchestra.run.smithi086:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-03-06T13:48:16.151 INFO:teuthology.orchestra.run.smithi086.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-03-06T13:48:16.152 INFO:teuthology.orchestra.run.smithi086.stdout: = sectsz=512 attr=2, projid32bit=1 2023-03-06T13:48:16.152 INFO:teuthology.orchestra.run.smithi086.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-03-06T13:48:16.152 INFO:teuthology.orchestra.run.smithi086.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-03-06T13:48:16.152 INFO:teuthology.orchestra.run.smithi086.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-03-06T13:48:16.152 INFO:teuthology.orchestra.run.smithi086.stdout: = sunit=0 swidth=0 blks 2023-03-06T13:48:16.153 INFO:teuthology.orchestra.run.smithi086.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-03-06T13:48:16.153 INFO:teuthology.orchestra.run.smithi086.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-03-06T13:48:16.153 INFO:teuthology.orchestra.run.smithi086.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-03-06T13:48:16.153 INFO:teuthology.orchestra.run.smithi086.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-03-06T13:48:16.567 INFO:teuthology.orchestra.run.smithi086.stdout:Discarding blocks...Done. 2023-03-06T13:48:16.568 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi086.front.sepia.ceph.com -o noatime 2023-03-06T13:48:16.569 DEBUG:teuthology.orchestra.run.smithi086:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-03-06T13:48:16.653 DEBUG:teuthology.orchestra.run.smithi086:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-03-06T13:48:16.683 DEBUG:teuthology.orchestra.run.smithi086:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-03-06T13:48:16.750 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-03-06T13:48:16.751 INFO:tasks.ceph:role: osd.2 2023-03-06T13:48:16.751 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi086.front.sepia.ceph.com 2023-03-06T13:48:16.752 DEBUG:teuthology.orchestra.run.smithi086:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-03-06T13:48:16.824 INFO:teuthology.orchestra.run.smithi086.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-03-06T13:48:16.825 INFO:teuthology.orchestra.run.smithi086.stdout: = sectsz=512 attr=2, projid32bit=1 2023-03-06T13:48:16.825 INFO:teuthology.orchestra.run.smithi086.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-03-06T13:48:16.825 INFO:teuthology.orchestra.run.smithi086.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-03-06T13:48:16.825 INFO:teuthology.orchestra.run.smithi086.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-03-06T13:48:16.826 INFO:teuthology.orchestra.run.smithi086.stdout: = sunit=0 swidth=0 blks 2023-03-06T13:48:16.826 INFO:teuthology.orchestra.run.smithi086.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-03-06T13:48:16.826 INFO:teuthology.orchestra.run.smithi086.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-03-06T13:48:16.827 INFO:teuthology.orchestra.run.smithi086.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-03-06T13:48:16.827 INFO:teuthology.orchestra.run.smithi086.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-03-06T13:48:17.277 INFO:teuthology.orchestra.run.smithi086.stdout:Discarding blocks...Done. 2023-03-06T13:48:17.278 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi086.front.sepia.ceph.com -o noatime 2023-03-06T13:48:17.278 DEBUG:teuthology.orchestra.run.smithi086:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-03-06T13:48:17.394 DEBUG:teuthology.orchestra.run.smithi086:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-03-06T13:48:17.427 DEBUG:teuthology.orchestra.run.smithi086:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-03-06T13:48:17.494 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-03-06T13:48:17.494 INFO:tasks.ceph:role: osd.3 2023-03-06T13:48:17.495 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi086.front.sepia.ceph.com 2023-03-06T13:48:17.495 DEBUG:teuthology.orchestra.run.smithi086:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-03-06T13:48:17.568 INFO:teuthology.orchestra.run.smithi086.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-03-06T13:48:17.569 INFO:teuthology.orchestra.run.smithi086.stdout: = sectsz=512 attr=2, projid32bit=1 2023-03-06T13:48:17.569 INFO:teuthology.orchestra.run.smithi086.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-03-06T13:48:17.569 INFO:teuthology.orchestra.run.smithi086.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-03-06T13:48:17.569 INFO:teuthology.orchestra.run.smithi086.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-03-06T13:48:17.569 INFO:teuthology.orchestra.run.smithi086.stdout: = sunit=0 swidth=0 blks 2023-03-06T13:48:17.569 INFO:teuthology.orchestra.run.smithi086.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-03-06T13:48:17.570 INFO:teuthology.orchestra.run.smithi086.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-03-06T13:48:17.570 INFO:teuthology.orchestra.run.smithi086.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-03-06T13:48:17.570 INFO:teuthology.orchestra.run.smithi086.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-03-06T13:48:18.016 INFO:teuthology.orchestra.run.smithi086.stdout:Discarding blocks...Done. 2023-03-06T13:48:18.018 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi086.front.sepia.ceph.com -o noatime 2023-03-06T13:48:18.019 DEBUG:teuthology.orchestra.run.smithi086:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-03-06T13:48:18.186 DEBUG:teuthology.orchestra.run.smithi086:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-03-06T13:48:18.225 DEBUG:teuthology.orchestra.run.smithi086:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-03-06T13:48:18.706 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:48:18.705+0000 7fd712d1e640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-03-06T13:48:18.706 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:48:18.705+0000 7fd712d1e640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-03-06T13:48:18.706 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:48:18.705+0000 7fd712d1e640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-03-06T13:48:18.707 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:48:18.705+0000 7fd712d1e640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-03-06T13:48:18.707 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:48:18.705+0000 7fd712d1e640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-03-06T13:48:18.707 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:48:18.705+0000 7fd712d1e640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-03-06T13:48:21.571 DEBUG:teuthology.orchestra.run.smithi086:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-03-06T13:48:21.602 DEBUG:teuthology.orchestra.run.smithi086:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-03-06T13:48:21.693 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:48:21.691+0000 7ff283392640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-03-06T13:48:21.693 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:48:21.692+0000 7ff283392640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-03-06T13:48:21.693 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:48:21.692+0000 7ff283392640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-03-06T13:48:21.693 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:48:21.692+0000 7ff283392640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-03-06T13:48:21.693 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:48:21.692+0000 7ff283392640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-03-06T13:48:21.694 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:48:21.692+0000 7ff283392640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-03-06T13:48:24.556 DEBUG:teuthology.orchestra.run.smithi086:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-03-06T13:48:24.588 DEBUG:teuthology.orchestra.run.smithi086:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-03-06T13:48:24.680 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:48:24.678+0000 7fd9bcc96640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-03-06T13:48:24.680 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:48:24.679+0000 7fd9bcc96640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-03-06T13:48:24.680 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:48:24.679+0000 7fd9bcc96640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-03-06T13:48:24.680 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:48:24.679+0000 7fd9bcc96640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-03-06T13:48:24.681 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:48:24.679+0000 7fd9bcc96640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-03-06T13:48:24.681 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:48:24.679+0000 7fd9bcc96640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-03-06T13:48:27.546 DEBUG:teuthology.orchestra.run.smithi086:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-03-06T13:48:27.577 DEBUG:teuthology.orchestra.run.smithi086:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-03-06T13:48:27.671 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:48:27.670+0000 7fdf02b90640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-03-06T13:48:27.671 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:48:27.670+0000 7fdf02b90640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-03-06T13:48:27.671 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:48:27.670+0000 7fdf02b90640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-03-06T13:48:27.671 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:48:27.670+0000 7fdf02b90640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-03-06T13:48:27.671 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:48:27.670+0000 7fdf02b90640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-03-06T13:48:27.672 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:48:27.670+0000 7fdf02b90640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-03-06T13:48:30.547 DEBUG:teuthology.orchestra.run.smithi086:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-03-06T13:48:30.579 DEBUG:teuthology.orchestra.run.smithi202:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-03-06T13:48:30.612 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-03-06T13:48:30.613 INFO:tasks.ceph:role: osd.4 2023-03-06T13:48:30.613 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi202.front.sepia.ceph.com 2023-03-06T13:48:30.613 DEBUG:teuthology.orchestra.run.smithi202:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-03-06T13:48:30.691 INFO:teuthology.orchestra.run.smithi202.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-03-06T13:48:30.692 INFO:teuthology.orchestra.run.smithi202.stdout: = sectsz=512 attr=2, projid32bit=1 2023-03-06T13:48:30.692 INFO:teuthology.orchestra.run.smithi202.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-03-06T13:48:30.692 INFO:teuthology.orchestra.run.smithi202.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-03-06T13:48:30.692 INFO:teuthology.orchestra.run.smithi202.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-03-06T13:48:30.692 INFO:teuthology.orchestra.run.smithi202.stdout: = sunit=0 swidth=0 blks 2023-03-06T13:48:30.693 INFO:teuthology.orchestra.run.smithi202.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-03-06T13:48:30.693 INFO:teuthology.orchestra.run.smithi202.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-03-06T13:48:30.693 INFO:teuthology.orchestra.run.smithi202.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-03-06T13:48:30.693 INFO:teuthology.orchestra.run.smithi202.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-03-06T13:48:31.118 INFO:teuthology.orchestra.run.smithi202.stdout:Discarding blocks...Done. 2023-03-06T13:48:31.121 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi202.front.sepia.ceph.com -o noatime 2023-03-06T13:48:31.121 DEBUG:teuthology.orchestra.run.smithi202:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-03-06T13:48:31.266 DEBUG:teuthology.orchestra.run.smithi202:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-03-06T13:48:31.305 DEBUG:teuthology.orchestra.run.smithi202:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-03-06T13:48:31.378 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-03-06T13:48:31.379 INFO:tasks.ceph:role: osd.5 2023-03-06T13:48:31.379 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi202.front.sepia.ceph.com 2023-03-06T13:48:31.379 DEBUG:teuthology.orchestra.run.smithi202:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-03-06T13:48:31.458 INFO:teuthology.orchestra.run.smithi202.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-03-06T13:48:31.458 INFO:teuthology.orchestra.run.smithi202.stdout: = sectsz=512 attr=2, projid32bit=1 2023-03-06T13:48:31.459 INFO:teuthology.orchestra.run.smithi202.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-03-06T13:48:31.459 INFO:teuthology.orchestra.run.smithi202.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-03-06T13:48:31.459 INFO:teuthology.orchestra.run.smithi202.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-03-06T13:48:31.459 INFO:teuthology.orchestra.run.smithi202.stdout: = sunit=0 swidth=0 blks 2023-03-06T13:48:31.459 INFO:teuthology.orchestra.run.smithi202.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-03-06T13:48:31.459 INFO:teuthology.orchestra.run.smithi202.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-03-06T13:48:31.459 INFO:teuthology.orchestra.run.smithi202.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-03-06T13:48:31.460 INFO:teuthology.orchestra.run.smithi202.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-03-06T13:48:31.884 INFO:teuthology.orchestra.run.smithi202.stdout:Discarding blocks...Done. 2023-03-06T13:48:31.886 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi202.front.sepia.ceph.com -o noatime 2023-03-06T13:48:31.886 DEBUG:teuthology.orchestra.run.smithi202:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-03-06T13:48:32.006 DEBUG:teuthology.orchestra.run.smithi202:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-03-06T13:48:32.043 DEBUG:teuthology.orchestra.run.smithi202:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-03-06T13:48:32.116 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-03-06T13:48:32.117 INFO:tasks.ceph:role: osd.6 2023-03-06T13:48:32.117 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi202.front.sepia.ceph.com 2023-03-06T13:48:32.117 DEBUG:teuthology.orchestra.run.smithi202:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-03-06T13:48:32.197 INFO:teuthology.orchestra.run.smithi202.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-03-06T13:48:32.197 INFO:teuthology.orchestra.run.smithi202.stdout: = sectsz=512 attr=2, projid32bit=1 2023-03-06T13:48:32.198 INFO:teuthology.orchestra.run.smithi202.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-03-06T13:48:32.198 INFO:teuthology.orchestra.run.smithi202.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-03-06T13:48:32.198 INFO:teuthology.orchestra.run.smithi202.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-03-06T13:48:32.198 INFO:teuthology.orchestra.run.smithi202.stdout: = sunit=0 swidth=0 blks 2023-03-06T13:48:32.198 INFO:teuthology.orchestra.run.smithi202.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-03-06T13:48:32.198 INFO:teuthology.orchestra.run.smithi202.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-03-06T13:48:32.199 INFO:teuthology.orchestra.run.smithi202.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-03-06T13:48:32.199 INFO:teuthology.orchestra.run.smithi202.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-03-06T13:48:32.650 INFO:teuthology.orchestra.run.smithi202.stdout:Discarding blocks...Done. 2023-03-06T13:48:32.652 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi202.front.sepia.ceph.com -o noatime 2023-03-06T13:48:32.652 DEBUG:teuthology.orchestra.run.smithi202:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-03-06T13:48:32.811 DEBUG:teuthology.orchestra.run.smithi202:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-03-06T13:48:32.847 DEBUG:teuthology.orchestra.run.smithi202:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-03-06T13:48:32.917 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-03-06T13:48:32.918 INFO:tasks.ceph:role: osd.7 2023-03-06T13:48:32.918 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi202.front.sepia.ceph.com 2023-03-06T13:48:32.918 DEBUG:teuthology.orchestra.run.smithi202:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-03-06T13:48:32.995 INFO:teuthology.orchestra.run.smithi202.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-03-06T13:48:32.995 INFO:teuthology.orchestra.run.smithi202.stdout: = sectsz=512 attr=2, projid32bit=1 2023-03-06T13:48:32.995 INFO:teuthology.orchestra.run.smithi202.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-03-06T13:48:32.996 INFO:teuthology.orchestra.run.smithi202.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-03-06T13:48:32.996 INFO:teuthology.orchestra.run.smithi202.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-03-06T13:48:32.996 INFO:teuthology.orchestra.run.smithi202.stdout: = sunit=0 swidth=0 blks 2023-03-06T13:48:32.996 INFO:teuthology.orchestra.run.smithi202.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-03-06T13:48:32.996 INFO:teuthology.orchestra.run.smithi202.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-03-06T13:48:32.996 INFO:teuthology.orchestra.run.smithi202.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-03-06T13:48:32.996 INFO:teuthology.orchestra.run.smithi202.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-03-06T13:48:33.433 INFO:teuthology.orchestra.run.smithi202.stdout:Discarding blocks...Done. 2023-03-06T13:48:33.434 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi202.front.sepia.ceph.com -o noatime 2023-03-06T13:48:33.435 DEBUG:teuthology.orchestra.run.smithi202:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-03-06T13:48:33.573 DEBUG:teuthology.orchestra.run.smithi202:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-03-06T13:48:33.610 DEBUG:teuthology.orchestra.run.smithi202:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-03-06T13:48:33.715 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:33.713+0000 7fc6ab314640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-03-06T13:48:33.716 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:33.714+0000 7fc6ab314640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-03-06T13:48:33.716 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:33.714+0000 7fc6ab314640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-03-06T13:48:33.716 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:33.714+0000 7fc6ab314640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-03-06T13:48:33.716 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:33.714+0000 7fc6ab314640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-03-06T13:48:33.717 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:33.714+0000 7fc6ab314640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-03-06T13:48:36.587 DEBUG:teuthology.orchestra.run.smithi202:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-03-06T13:48:36.623 DEBUG:teuthology.orchestra.run.smithi202:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-03-06T13:48:36.719 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:36.717+0000 7fa1e9522640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-03-06T13:48:36.719 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:36.718+0000 7fa1e9522640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-03-06T13:48:36.720 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:36.718+0000 7fa1e9522640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-03-06T13:48:36.720 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:36.718+0000 7fa1e9522640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-03-06T13:48:36.720 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:36.718+0000 7fa1e9522640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-03-06T13:48:36.720 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:36.718+0000 7fa1e9522640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-03-06T13:48:39.579 DEBUG:teuthology.orchestra.run.smithi202:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-03-06T13:48:39.610 DEBUG:teuthology.orchestra.run.smithi202:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-03-06T13:48:39.700 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:39.699+0000 7fcd882cb640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-03-06T13:48:39.701 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:39.699+0000 7fcd882cb640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-03-06T13:48:39.701 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:39.699+0000 7fcd882cb640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-03-06T13:48:39.701 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:39.699+0000 7fcd882cb640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-03-06T13:48:39.701 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:39.699+0000 7fcd882cb640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-03-06T13:48:39.702 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:39.699+0000 7fcd882cb640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-03-06T13:48:42.198 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T13:48:42.201 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T13:48:42.574 DEBUG:teuthology.orchestra.run.smithi202:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-03-06T13:48:42.607 DEBUG:teuthology.orchestra.run.smithi202:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-03-06T13:48:42.702 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:42.700+0000 7fe9a3917640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-03-06T13:48:42.702 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:42.700+0000 7fe9a3917640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-03-06T13:48:42.702 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:42.700+0000 7fe9a3917640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-03-06T13:48:42.702 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:42.700+0000 7fe9a3917640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-03-06T13:48:42.702 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:42.700+0000 7fe9a3917640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-03-06T13:48:42.703 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:42.701+0000 7fe9a3917640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-03-06T13:48:45.562 DEBUG:teuthology.orchestra.run.smithi202:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-03-06T13:48:45.595 INFO:tasks.ceph:Reading keys from all nodes... 2023-03-06T13:48:45.596 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2023-03-06T13:48:45.596 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-03-06T13:48:45.627 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2023-03-06T13:48:45.628 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-03-06T13:48:45.697 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2023-03-06T13:48:45.698 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-03-06T13:48:45.767 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2023-03-06T13:48:45.767 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-03-06T13:48:45.834 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2023-03-06T13:48:45.835 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-03-06T13:48:45.902 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2023-03-06T13:48:45.903 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-03-06T13:48:45.969 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2023-03-06T13:48:45.970 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-03-06T13:48:46.036 DEBUG:teuthology.orchestra.run.smithi202:> set -ex 2023-03-06T13:48:46.037 DEBUG:teuthology.orchestra.run.smithi202:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-03-06T13:48:46.068 DEBUG:teuthology.orchestra.run.smithi202:> set -ex 2023-03-06T13:48:46.068 DEBUG:teuthology.orchestra.run.smithi202:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-03-06T13:48:46.138 DEBUG:teuthology.orchestra.run.smithi202:> set -ex 2023-03-06T13:48:46.138 DEBUG:teuthology.orchestra.run.smithi202:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2023-03-06T13:48:46.207 DEBUG:teuthology.orchestra.run.smithi202:> set -ex 2023-03-06T13:48:46.208 DEBUG:teuthology.orchestra.run.smithi202:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-03-06T13:48:46.275 DEBUG:teuthology.orchestra.run.smithi202:> set -ex 2023-03-06T13:48:46.276 DEBUG:teuthology.orchestra.run.smithi202:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-03-06T13:48:46.343 DEBUG:teuthology.orchestra.run.smithi202:> set -ex 2023-03-06T13:48:46.343 DEBUG:teuthology.orchestra.run.smithi202:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-03-06T13:48:46.410 DEBUG:teuthology.orchestra.run.smithi202:> set -ex 2023-03-06T13:48:46.410 DEBUG:teuthology.orchestra.run.smithi202:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-03-06T13:48:46.476 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2023-03-06T13:48:46.477 DEBUG:teuthology.orchestra.run.smithi086:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-03-06T13:48:46.494 INFO:tasks.ceph:Adding keys to all mons... 2023-03-06T13:48:46.494 DEBUG:teuthology.orchestra.run.smithi086:> sudo tee -a /etc/ceph/ceph.keyring 2023-03-06T13:48:46.537 DEBUG:teuthology.orchestra.run.smithi202:> sudo tee -a /etc/ceph/ceph.keyring 2023-03-06T13:48:46.560 INFO:teuthology.orchestra.run.smithi086.stdout:[mgr.y] 2023-03-06T13:48:46.561 INFO:teuthology.orchestra.run.smithi086.stdout: key = AQAe7wVk7UCxKhAAbiwySjbecii9kvAEi5l5kQ== 2023-03-06T13:48:46.561 INFO:teuthology.orchestra.run.smithi086.stdout:[mds.a] 2023-03-06T13:48:46.561 INFO:teuthology.orchestra.run.smithi086.stdout: key = AQAe7wVkwanoMhAAQ7MDWhQBB6JrrXrnBCiIXg== 2023-03-06T13:48:46.561 INFO:teuthology.orchestra.run.smithi086.stdout:[mds.c] 2023-03-06T13:48:46.561 INFO:teuthology.orchestra.run.smithi086.stdout: key = AQAe7wVkvl0xOhAASLUU9WtJgKZq2fA3bUOUkQ== 2023-03-06T13:48:46.561 INFO:teuthology.orchestra.run.smithi086.stdout:[osd.0] 2023-03-06T13:48:46.562 INFO:teuthology.orchestra.run.smithi086.stdout: key = AQAi7wVkzLMKKhAAENGla9QDK+NNgJ/AmLuZkg== 2023-03-06T13:48:46.562 INFO:teuthology.orchestra.run.smithi086.stdout:[osd.1] 2023-03-06T13:48:46.562 INFO:teuthology.orchestra.run.smithi086.stdout: key = AQAl7wVkmKBCKRAAl/DtimWKhi1mWIeTWpQa5Q== 2023-03-06T13:48:46.562 INFO:teuthology.orchestra.run.smithi086.stdout:[osd.2] 2023-03-06T13:48:46.562 INFO:teuthology.orchestra.run.smithi086.stdout: key = AQAo7wVkwGF9KBAAptUu3zmZ3txlbt7Z81K2kw== 2023-03-06T13:48:46.562 INFO:teuthology.orchestra.run.smithi086.stdout:[osd.3] 2023-03-06T13:48:46.562 INFO:teuthology.orchestra.run.smithi086.stdout: key = AQAr7wVkxnf0JxAAlv5MRnOpNLYIPTuc05DYag== 2023-03-06T13:48:46.562 INFO:teuthology.orchestra.run.smithi086.stdout:[mgr.x] 2023-03-06T13:48:46.563 INFO:teuthology.orchestra.run.smithi086.stdout: key = AQAe7wVkWk54LxAA8Wegr+85ancwTh5+sV0xhg== 2023-03-06T13:48:46.563 INFO:teuthology.orchestra.run.smithi086.stdout:[mds.b] 2023-03-06T13:48:46.563 INFO:teuthology.orchestra.run.smithi086.stdout: key = AQAf7wVkoY6CAxAAVrYq/H7mG8Hcvg3KoAz3rg== 2023-03-06T13:48:46.563 INFO:teuthology.orchestra.run.smithi086.stdout:[mds.d] 2023-03-06T13:48:46.563 INFO:teuthology.orchestra.run.smithi086.stdout: key = AQAf7wVk/jG4ChAAINtTt8pRI581wanBEZeoog== 2023-03-06T13:48:46.563 INFO:teuthology.orchestra.run.smithi086.stdout:[osd.4] 2023-03-06T13:48:46.563 INFO:teuthology.orchestra.run.smithi086.stdout: key = AQAx7wVkD96cKhAA9HsMxsrY6Gn55T0EdMQ7ng== 2023-03-06T13:48:46.564 INFO:teuthology.orchestra.run.smithi086.stdout:[osd.5] 2023-03-06T13:48:46.564 INFO:teuthology.orchestra.run.smithi086.stdout: key = AQA07wVkm0HZKhAAIxqzyGjhbB5BFAw8K49Hfg== 2023-03-06T13:48:46.564 INFO:teuthology.orchestra.run.smithi086.stdout:[osd.6] 2023-03-06T13:48:46.564 INFO:teuthology.orchestra.run.smithi086.stdout: key = AQA37wVkw0K8KRAAQFS0bwIhs3mHvL3S82Yg8w== 2023-03-06T13:48:46.564 INFO:teuthology.orchestra.run.smithi086.stdout:[osd.7] 2023-03-06T13:48:46.564 INFO:teuthology.orchestra.run.smithi086.stdout: key = AQA67wVk4urOKRAA1EFS7v+LunQE3uHjOqZ9tQ== 2023-03-06T13:48:46.564 INFO:teuthology.orchestra.run.smithi086.stdout:[client.0] 2023-03-06T13:48:46.564 INFO:teuthology.orchestra.run.smithi086.stdout: key = AQAf7wVkANf+DhAAVs0vItuASTaESvkjGstWiQ== 2023-03-06T13:48:46.566 INFO:teuthology.orchestra.run.smithi202.stdout:[mgr.y] 2023-03-06T13:48:46.566 INFO:teuthology.orchestra.run.smithi202.stdout: key = AQAe7wVk7UCxKhAAbiwySjbecii9kvAEi5l5kQ== 2023-03-06T13:48:46.566 INFO:teuthology.orchestra.run.smithi202.stdout:[mds.a] 2023-03-06T13:48:46.566 INFO:teuthology.orchestra.run.smithi202.stdout: key = AQAe7wVkwanoMhAAQ7MDWhQBB6JrrXrnBCiIXg== 2023-03-06T13:48:46.566 INFO:teuthology.orchestra.run.smithi202.stdout:[mds.c] 2023-03-06T13:48:46.567 INFO:teuthology.orchestra.run.smithi202.stdout: key = AQAe7wVkvl0xOhAASLUU9WtJgKZq2fA3bUOUkQ== 2023-03-06T13:48:46.567 INFO:teuthology.orchestra.run.smithi202.stdout:[osd.0] 2023-03-06T13:48:46.567 INFO:teuthology.orchestra.run.smithi202.stdout: key = AQAi7wVkzLMKKhAAENGla9QDK+NNgJ/AmLuZkg== 2023-03-06T13:48:46.567 INFO:teuthology.orchestra.run.smithi202.stdout:[osd.1] 2023-03-06T13:48:46.567 INFO:teuthology.orchestra.run.smithi202.stdout: key = AQAl7wVkmKBCKRAAl/DtimWKhi1mWIeTWpQa5Q== 2023-03-06T13:48:46.567 INFO:teuthology.orchestra.run.smithi202.stdout:[osd.2] 2023-03-06T13:48:46.567 INFO:teuthology.orchestra.run.smithi202.stdout: key = AQAo7wVkwGF9KBAAptUu3zmZ3txlbt7Z81K2kw== 2023-03-06T13:48:46.567 INFO:teuthology.orchestra.run.smithi202.stdout:[osd.3] 2023-03-06T13:48:46.568 INFO:teuthology.orchestra.run.smithi202.stdout: key = AQAr7wVkxnf0JxAAlv5MRnOpNLYIPTuc05DYag== 2023-03-06T13:48:46.568 INFO:teuthology.orchestra.run.smithi202.stdout:[mgr.x] 2023-03-06T13:48:46.568 INFO:teuthology.orchestra.run.smithi202.stdout: key = AQAe7wVkWk54LxAA8Wegr+85ancwTh5+sV0xhg== 2023-03-06T13:48:46.568 INFO:teuthology.orchestra.run.smithi202.stdout:[mds.b] 2023-03-06T13:48:46.568 INFO:teuthology.orchestra.run.smithi202.stdout: key = AQAf7wVkoY6CAxAAVrYq/H7mG8Hcvg3KoAz3rg== 2023-03-06T13:48:46.568 INFO:teuthology.orchestra.run.smithi202.stdout:[mds.d] 2023-03-06T13:48:46.568 INFO:teuthology.orchestra.run.smithi202.stdout: key = AQAf7wVk/jG4ChAAINtTt8pRI581wanBEZeoog== 2023-03-06T13:48:46.568 INFO:teuthology.orchestra.run.smithi202.stdout:[osd.4] 2023-03-06T13:48:46.569 INFO:teuthology.orchestra.run.smithi202.stdout: key = AQAx7wVkD96cKhAA9HsMxsrY6Gn55T0EdMQ7ng== 2023-03-06T13:48:46.569 INFO:teuthology.orchestra.run.smithi202.stdout:[osd.5] 2023-03-06T13:48:46.569 INFO:teuthology.orchestra.run.smithi202.stdout: key = AQA07wVkm0HZKhAAIxqzyGjhbB5BFAw8K49Hfg== 2023-03-06T13:48:46.569 INFO:teuthology.orchestra.run.smithi202.stdout:[osd.6] 2023-03-06T13:48:46.569 INFO:teuthology.orchestra.run.smithi202.stdout: key = AQA37wVkw0K8KRAAQFS0bwIhs3mHvL3S82Yg8w== 2023-03-06T13:48:46.569 INFO:teuthology.orchestra.run.smithi202.stdout:[osd.7] 2023-03-06T13:48:46.569 INFO:teuthology.orchestra.run.smithi202.stdout: key = AQA67wVk4urOKRAA1EFS7v+LunQE3uHjOqZ9tQ== 2023-03-06T13:48:46.570 INFO:teuthology.orchestra.run.smithi202.stdout:[client.0] 2023-03-06T13:48:46.570 INFO:teuthology.orchestra.run.smithi202.stdout: key = AQAf7wVkANf+DhAAVs0vItuASTaESvkjGstWiQ== 2023-03-06T13:48:46.570 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-03-06T13:48:46.608 DEBUG:teuthology.orchestra.run.smithi202:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-03-06T13:48:46.662 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-03-06T13:48:46.664 DEBUG:teuthology.orchestra.run.smithi202:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-03-06T13:48:46.719 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-03-06T13:48:46.726 DEBUG:teuthology.orchestra.run.smithi202:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-03-06T13:48:46.781 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-03-06T13:48:46.785 DEBUG:teuthology.orchestra.run.smithi202:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-03-06T13:48:46.838 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-03-06T13:48:46.840 DEBUG:teuthology.orchestra.run.smithi202:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-03-06T13:48:46.893 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-03-06T13:48:46.896 DEBUG:teuthology.orchestra.run.smithi202:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-03-06T13:48:46.948 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-03-06T13:48:46.951 DEBUG:teuthology.orchestra.run.smithi202:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-03-06T13:48:47.003 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-03-06T13:48:47.005 DEBUG:teuthology.orchestra.run.smithi202:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-03-06T13:48:47.058 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-03-06T13:48:47.061 DEBUG:teuthology.orchestra.run.smithi202:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-03-06T13:48:47.117 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-03-06T13:48:47.119 DEBUG:teuthology.orchestra.run.smithi202:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-03-06T13:48:47.176 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-03-06T13:48:47.179 DEBUG:teuthology.orchestra.run.smithi202:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-03-06T13:48:47.232 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-03-06T13:48:47.234 DEBUG:teuthology.orchestra.run.smithi202:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-03-06T13:48:47.287 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-03-06T13:48:47.289 DEBUG:teuthology.orchestra.run.smithi202:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-03-06T13:48:47.342 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-03-06T13:48:47.344 DEBUG:teuthology.orchestra.run.smithi202:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-03-06T13:48:47.397 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-03-06T13:48:47.400 DEBUG:teuthology.orchestra.run.smithi202:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-03-06T13:48:47.456 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-03-06T13:48:47.458 DEBUG:teuthology.orchestra.run.smithi086:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-03-06T13:48:47.484 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-03-06T13:48:47.581 DEBUG:teuthology.orchestra.run.smithi086:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-03-06T13:48:47.608 DEBUG:teuthology.orchestra.run.smithi202:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-03-06T13:48:47.634 DEBUG:teuthology.orchestra.run.smithi202:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-03-06T13:48:47.732 DEBUG:teuthology.orchestra.run.smithi202:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-03-06T13:48:47.758 DEBUG:teuthology.orchestra.run.smithi202:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-03-06T13:48:47.825 DEBUG:teuthology.orchestra.run.smithi202:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-03-06T13:48:47.924 DEBUG:teuthology.orchestra.run.smithi202:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-03-06T13:48:47.951 DEBUG:teuthology.orchestra.run.smithi086:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-03-06T13:48:47.953 DEBUG:teuthology.orchestra.run.smithi202:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-03-06T13:48:48.007 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-03-06T13:48:48.007 INFO:tasks.ceph.mon.a:Restarting daemon 2023-03-06T13:48:48.008 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-03-06T13:48:48.011 INFO:tasks.ceph.mon.a:Started 2023-03-06T13:48:48.011 INFO:tasks.ceph.mon.b:Restarting daemon 2023-03-06T13:48:48.012 DEBUG:teuthology.orchestra.run.smithi202:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-03-06T13:48:48.050 INFO:tasks.ceph.mon.b:Started 2023-03-06T13:48:48.051 INFO:tasks.ceph.mon.c:Restarting daemon 2023-03-06T13:48:48.051 DEBUG:teuthology.orchestra.run.smithi202:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-03-06T13:48:48.052 INFO:tasks.ceph.mon.c:Started 2023-03-06T13:48:48.053 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-03-06T13:48:48.053 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-03-06T13:48:48.053 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-03-06T13:48:48.055 INFO:tasks.ceph.mgr.y:Started 2023-03-06T13:48:48.056 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-03-06T13:48:48.056 DEBUG:teuthology.orchestra.run.smithi202:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-03-06T13:48:48.058 INFO:tasks.ceph.mgr.x:Started 2023-03-06T13:48:48.058 INFO:tasks.ceph:Setting crush tunables to default 2023-03-06T13:48:48.058 DEBUG:teuthology.orchestra.run.smithi086:> sudo ceph --cluster ceph osd crush tunables default 2023-03-06T13:48:48.182 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:48:48.178+0000 7f8bab1c2700 1 Processor -- start 2023-03-06T13:48:48.182 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:48:48.178+0000 7f8bab1c2700 1 -- start start 2023-03-06T13:48:48.182 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:48:48.178+0000 7f8bab1c2700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f8ba406ea90 0x7f8ba414f0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:48:48.183 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:48:48.178+0000 7f8bab1c2700 1 --2- >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f8ba414f600 0x7f8ba4159a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:48:48.183 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:48:48.178+0000 7f8bab1c2700 1 -- --> v1:172.21.15.202:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ba4153340 con 0x7f8ba4149420 2023-03-06T13:48:48.183 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:48:48.178+0000 7f8bab1c2700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ba41497f0 con 0x7f8ba406ea90 2023-03-06T13:48:48.183 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:48:48.178+0000 7f8bab1c2700 1 -- --> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ba4152750 con 0x7f8ba414f600 2023-03-06T13:48:48.183 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:48:48.179+0000 7f8ba3fff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f8ba406ea90 0x7f8ba414f0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:48:48.183 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:48:48.179+0000 7f8ba3fff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f8ba406ea90 0x7f8ba414f0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:37898/0 (socket says 172.21.15.86:37898) 2023-03-06T13:48:48.183 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:48:48.179+0000 7f8ba3fff700 1 -- 172.21.15.86:0/496459970 learned_addr learned my addr 172.21.15.86:0/496459970 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-03-06T13:48:48.184 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:48:48.179+0000 7f8ba3fff700 1 -- 172.21.15.86:0/496459970 >> v2:172.21.15.86:3300/0 conn(0x7f8ba406ea90 msgr2=0x7f8ba414f0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-03-06T13:48:48.184 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:48:48.179+0000 7f8ba3fff700 1 -- 172.21.15.86:0/496459970 >> v2:172.21.15.86:3300/0 conn(0x7f8ba406ea90 msgr2=0x7f8ba414f0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-06T13:48:48.184 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:48:48.179+0000 7f8ba3fff700 1 --2- 172.21.15.86:0/496459970 >> v2:172.21.15.86:3300/0 conn(0x7f8ba406ea90 0x7f8ba414f0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-06T13:48:48.184 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:48:48.179+0000 7f8ba3fff700 1 --2- 172.21.15.86:0/496459970 >> v2:172.21.15.86:3300/0 conn(0x7f8ba406ea90 0x7f8ba414f0c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-03-06T13:48:48.184 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:48:48.179+0000 7f8ba975f700 1 --2- 172.21.15.86:0/496459970 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f8ba414f600 0x7f8ba4159a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:48:48.184 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:48:48.179+0000 7f8ba975f700 1 -- 172.21.15.86:0/496459970 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f8ba414f600 msgr2=0x7f8ba4159a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-06T13:48:48.184 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:48:48.179+0000 7f8ba975f700 1 -- 172.21.15.86:0/496459970 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f8ba414f600 msgr2=0x7f8ba4159a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-06T13:48:48.184 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:48:48.179+0000 7f8ba975f700 1 --2- 172.21.15.86:0/496459970 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f8ba414f600 0x7f8ba4159a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-06T13:48:48.185 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:48:48.179+0000 7f8ba975f700 1 --2- 172.21.15.86:0/496459970 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f8ba414f600 0x7f8ba4159a40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-03-06T13:48:48.368 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:48:48.366+0000 7f8ba37fe700 1 -- 172.21.15.86:0/496459970 <== mon.1 v1:172.21.15.202:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3879674167 0 0) 0x7f8ba4153340 con 0x7f8ba4149420 2023-03-06T13:48:48.368 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:48:48.366+0000 7f8ba37fe700 1 -- 172.21.15.86:0/496459970 --> v1:172.21.15.202:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8b940035b0 con 0x7f8ba4149420 2023-03-06T13:48:48.375 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:48:48.371+0000 7f8ba37fe700 1 -- 172.21.15.86:0/496459970 <== mon.1 v1:172.21.15.202:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1676258900 0 0) 0x7f8b940035b0 con 0x7f8ba4149420 2023-03-06T13:48:48.376 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:48:48.371+0000 7f8ba37fe700 1 -- 172.21.15.86:0/496459970 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f8ba414f600 msgr2=0x7f8ba4159a40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-03-06T13:48:48.376 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:48:48.371+0000 7f8ba37fe700 1 --2- 172.21.15.86:0/496459970 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f8ba414f600 0x7f8ba4159a40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:48:48.376 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:48:48.371+0000 7f8ba37fe700 1 -- 172.21.15.86:0/496459970 >> v2:172.21.15.86:3300/0 conn(0x7f8ba406ea90 msgr2=0x7f8ba414f0c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-03-06T13:48:48.376 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:48:48.371+0000 7f8ba37fe700 1 --2- 172.21.15.86:0/496459970 >> v2:172.21.15.86:3300/0 conn(0x7f8ba406ea90 0x7f8ba414f0c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:48:48.376 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:48:48.371+0000 7f8ba37fe700 1 -- 172.21.15.86:0/496459970 --> v1:172.21.15.202:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ba4152a10 con 0x7f8ba4149420 2023-03-06T13:48:48.377 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:48:48.372+0000 7f8ba37fe700 1 -- 172.21.15.86:0/496459970 <== mon.1 v1:172.21.15.202:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2191261126 0 0) 0x7f8b98001670 con 0x7f8ba4149420 2023-03-06T13:48:48.377 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:48:48.372+0000 7f8ba37fe700 1 -- 172.21.15.86:0/496459970 >> v1:172.21.15.202:6789/0 conn(0x7f8ba4149420 legacy=0x7f8ba40c2860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:48:48.377 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:48:48.372+0000 7f8ba37fe700 1 --2- 172.21.15.86:0/496459970 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f8b94003a00 0x7f8b94003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:48:48.377 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:48:48.372+0000 7f8ba37fe700 1 --2- 172.21.15.86:0/496459970 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8b94004850 0x7f8b94004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:48:48.377 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:48:48.372+0000 7f8ba37fe700 1 --2- 172.21.15.86:0/496459970 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f8ba414f600 0x7f8b94005260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:48:48.377 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:48:48.372+0000 7f8ba37fe700 1 -- 172.21.15.86:0/496459970 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ba41497f0 con 0x7f8b94004850 2023-03-06T13:48:48.377 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:48:48.372+0000 7f8ba37fe700 1 -- 172.21.15.86:0/496459970 --> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ba4152750 con 0x7f8b94003a00 2023-03-06T13:48:48.378 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:48:48.372+0000 7f8ba37fe700 1 -- 172.21.15.86:0/496459970 --> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b9400bbd0 con 0x7f8ba414f600 2023-03-06T13:48:48.378 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:48:48.372+0000 7f8ba3fff700 1 --2- 172.21.15.86:0/496459970 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8b94004850 0x7f8b94004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:48:48.379 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:48:48.372+0000 7f8ba8f5e700 1 --2- 172.21.15.86:0/496459970 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f8b94003a00 0x7f8b94003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:48:48.379 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:48:48.372+0000 7f8ba975f700 1 --2- 172.21.15.86:0/496459970 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f8ba414f600 0x7f8b94005260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:48:48.379 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:48:48.372+0000 7f8ba3fff700 1 -- 172.21.15.86:0/496459970 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f8ba414f600 msgr2=0x7f8b94005260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T13:48:48.379 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:48:48.372+0000 7f8ba3fff700 1 --2- 172.21.15.86:0/496459970 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f8ba414f600 0x7f8b94005260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:48:48.379 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:48:48.372+0000 7f8ba3fff700 1 -- 172.21.15.86:0/496459970 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f8b94003a00 msgr2=0x7f8b94003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T13:48:48.380 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:48:48.372+0000 7f8ba3fff700 1 --2- 172.21.15.86:0/496459970 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f8b94003a00 0x7f8b94003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:48:48.381 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:48:48.372+0000 7f8ba3fff700 1 -- 172.21.15.86:0/496459970 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b940035b0 con 0x7f8b94004850 2023-03-06T13:48:48.382 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:48:48.372+0000 7f8ba3fff700 1 --2- 172.21.15.86:0/496459970 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8b94004850 0x7f8b94004cc0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f8b90009910 tx=0x7f8b94005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8764ce47b8e85aa server_cookie=0 in_seq=0 out_seq=0 2023-03-06T13:48:48.382 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:48:48.372+0000 7f8ba37fe700 1 -- 172.21.15.86:0/496459970 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b9000c070 con 0x7f8b94004850 2023-03-06T13:48:48.382 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:48:48.372+0000 7f8ba37fe700 1 -- 172.21.15.86:0/496459970 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b90004020 con 0x7f8b94004850 2023-03-06T13:48:48.382 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:48:48.372+0000 7f8ba37fe700 1 -- 172.21.15.86:0/496459970 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b900043b0 con 0x7f8b94004850 2023-03-06T13:48:48.382 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:48:48.373+0000 7f8bab1c2700 1 -- 172.21.15.86:0/496459970 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8b94004850 msgr2=0x7f8b94004cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:48:48.383 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:48:48.373+0000 7f8bab1c2700 1 --2- 172.21.15.86:0/496459970 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8b94004850 0x7f8b94004cc0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f8b90009910 tx=0x7f8b94005880 comp rx=0 tx=0).stop 2023-03-06T13:48:48.383 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:48:48.373+0000 7f8ba975f700 1 -- 172.21.15.86:0/496459970 reap_dead start 2023-03-06T13:48:48.383 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:48:48.373+0000 7f8bab1c2700 1 -- 172.21.15.86:0/496459970 shutdown_connections 2023-03-06T13:48:48.383 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:48:48.373+0000 7f8bab1c2700 1 -- 172.21.15.86:0/496459970 >> 172.21.15.86:0/496459970 conn(0x7f8ba406c0d0 msgr2=0x7f8ba40c2150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T13:48:48.383 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:48:48.373+0000 7f8bab1c2700 1 -- 172.21.15.86:0/496459970 shutdown_connections 2023-03-06T13:48:48.383 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:48:48.373+0000 7f8bab1c2700 1 -- 172.21.15.86:0/496459970 wait complete. 2023-03-06T13:48:48.386 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:48:48.374+0000 7f8bab1c2700 1 Processor -- start 2023-03-06T13:48:48.386 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:48:48.374+0000 7f8bab1c2700 1 -- start start 2023-03-06T13:48:48.386 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:48:48.375+0000 7f8bab1c2700 1 --2- >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f8b94004850 0x7f8ba40bf3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:48:48.386 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:48:48.375+0000 7f8bab1c2700 1 --2- >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f8ba4146bc0 0x7f8ba4145700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:48:48.386 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:48:48.375+0000 7f8bab1c2700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8ba40b9110 0x7f8ba4145c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:48:48.386 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:48:48.375+0000 7f8bab1c2700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ba41e5f90 con 0x7f8ba40b9110 2023-03-06T13:48:48.387 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:48:48.375+0000 7f8bab1c2700 1 -- --> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ba40bf920 con 0x7f8ba4146bc0 2023-03-06T13:48:48.387 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:48:48.375+0000 7f8bab1c2700 1 -- --> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ba41e5a10 con 0x7f8b94004850 2023-03-06T13:48:48.387 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:48:48.375+0000 7f8ba975f700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8ba40b9110 0x7f8ba4145c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:48:48.387 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:48:48.375+0000 7f8ba8f5e700 1 --2- >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f8b94004850 0x7f8ba40bf3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:48:48.387 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:48:48.375+0000 7f8ba975f700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8ba40b9110 0x7f8ba4145c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:37932/0 (socket says 172.21.15.86:37932) 2023-03-06T13:48:48.387 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:48:48.375+0000 7f8ba975f700 1 -- 172.21.15.86:0/118443605 learned_addr learned my addr 172.21.15.86:0/118443605 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-03-06T13:48:48.387 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:48:48.376+0000 7f8ba3fff700 1 --2- 172.21.15.86:0/118443605 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f8ba4146bc0 0x7f8ba4145700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:48:48.387 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:48:48.376+0000 7f8ba975f700 1 -- 172.21.15.86:0/118443605 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f8b94004850 msgr2=0x7f8ba40bf3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:48:48.388 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:48:48.376+0000 7f8ba975f700 1 --2- 172.21.15.86:0/118443605 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f8b94004850 0x7f8ba40bf3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:48:48.388 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:48:48.376+0000 7f8ba975f700 1 -- 172.21.15.86:0/118443605 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f8ba4146bc0 msgr2=0x7f8ba4145700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:48:48.388 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:48:48.376+0000 7f8ba975f700 1 --2- 172.21.15.86:0/118443605 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f8ba4146bc0 0x7f8ba4145700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:48:48.388 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:48:48.376+0000 7f8ba975f700 1 -- 172.21.15.86:0/118443605 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ba4152fd0 con 0x7f8ba40b9110 2023-03-06T13:48:48.388 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:48:48.376+0000 7f8ba975f700 1 --2- 172.21.15.86:0/118443605 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8ba40b9110 0x7f8ba4145c40 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f8ba40bffe0 tx=0x7f8b9c00f430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T13:48:48.388 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:48:48.377+0000 7f8ba17fa700 1 -- 172.21.15.86:0/118443605 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b9c00fcf0 con 0x7f8ba40b9110 2023-03-06T13:48:48.388 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:48:48.377+0000 7f8ba17fa700 1 -- 172.21.15.86:0/118443605 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b9c00fe90 con 0x7f8ba40b9110 2023-03-06T13:48:48.389 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:48:48.377+0000 7f8bab1c2700 1 -- 172.21.15.86:0/118443605 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ba4152cf0 con 0x7f8ba40b9110 2023-03-06T13:48:48.389 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:48:48.377+0000 7f8ba17fa700 1 -- 172.21.15.86:0/118443605 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b9c003c60 con 0x7f8ba40b9110 2023-03-06T13:48:48.389 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:48:48.377+0000 7f8bab1c2700 1 -- 172.21.15.86:0/118443605 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ba406e610 con 0x7f8ba40b9110 2023-03-06T13:48:48.389 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:48:48.377+0000 7f8ba17fa700 1 -- 172.21.15.86:0/118443605 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 1) v1 ==== 656+0+0 (secure 0 0 0) 0x7f8b9c004320 con 0x7f8ba40b9110 2023-03-06T13:48:48.389 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:48:48.377+0000 7f8ba17fa700 1 -- 172.21.15.86:0/118443605 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f8b9c015780 con 0x7f8ba40b9110 2023-03-06T13:48:48.389 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:48:48.378+0000 7f8bab1c2700 1 -- 172.21.15.86:0/118443605 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ba404e750 con 0x7f8ba40b9110 2023-03-06T13:48:48.389 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:48:48.380+0000 7f8ba17fa700 1 -- 172.21.15.86:0/118443605 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7f8b9c003dc0 con 0x7f8ba40b9110 2023-03-06T13:48:48.456 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:48:48.454+0000 7f8bab1c2700 1 -- 172.21.15.86:0/118443605 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f8ba40b71a0 con 0x7f8ba40b9110 2023-03-06T13:48:48.461 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:48:48.459+0000 7f8ba17fa700 1 -- 172.21.15.86:0/118443605 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f8b9c004790 con 0x7f8ba40b9110 2023-03-06T13:48:48.462 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:48:48.461+0000 7f8bab1c2700 1 -- 172.21.15.86:0/118443605 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8ba40b9110 msgr2=0x7f8ba4145c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:48:48.463 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:48:48.461+0000 7f8bab1c2700 1 --2- 172.21.15.86:0/118443605 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8ba40b9110 0x7f8ba4145c40 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f8ba40bffe0 tx=0x7f8b9c00f430 comp rx=0 tx=0).stop 2023-03-06T13:48:48.463 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:48:48.461+0000 7f8bab1c2700 1 -- 172.21.15.86:0/118443605 shutdown_connections 2023-03-06T13:48:48.463 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:48:48.461+0000 7f8bab1c2700 1 --2- 172.21.15.86:0/118443605 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8ba40b9110 0x7f8ba4145c40 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:48:48.463 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:48:48.461+0000 7f8bab1c2700 1 --2- 172.21.15.86:0/118443605 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f8b94004850 0x7f8ba40bf3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:48:48.463 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:48:48.461+0000 7f8bab1c2700 1 --2- 172.21.15.86:0/118443605 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f8ba4146bc0 0x7f8ba4145700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:48:48.464 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:48:48.461+0000 7f8bab1c2700 1 -- 172.21.15.86:0/118443605 >> 172.21.15.86:0/118443605 conn(0x7f8ba406c0d0 msgr2=0x7f8ba406a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T13:48:48.464 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:48:48.461+0000 7f8bab1c2700 1 -- 172.21.15.86:0/118443605 shutdown_connections 2023-03-06T13:48:48.464 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:48:48.461+0000 7f8bab1c2700 1 -- 172.21.15.86:0/118443605 wait complete. 2023-03-06T13:48:48.464 INFO:teuthology.orchestra.run.smithi086.stderr:adjusted tunables profile to default 2023-03-06T13:48:48.478 INFO:tasks.ceph:check_enable_crimson: False 2023-03-06T13:48:48.479 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-03-06T13:48:48.479 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2023-03-06T13:48:48.479 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-03-06T13:48:48.491 INFO:tasks.ceph.mgr.x.smithi202.stderr:2023-03-06T13:48:48.489+0000 7f1742eb7200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-03-06T13:48:48.492 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-03-06T13:48:48.490+0000 7efc8307c200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-03-06T13:48:48.505 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2023-03-06T13:48:48.506 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-03-06T13:48:48.555 INFO:tasks.ceph.mgr.x.smithi202.stderr:2023-03-06T13:48:48.553+0000 7f1742eb7200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-03-06T13:48:48.560 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-03-06T13:48:48.558+0000 7efc8307c200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-03-06T13:48:48.571 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2023-03-06T13:48:48.572 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-03-06T13:48:48.628 INFO:tasks.ceph.mgr.x.smithi202.stderr:2023-03-06T13:48:48.627+0000 7f1742eb7200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-03-06T13:48:48.637 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2023-03-06T13:48:48.637 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-03-06T13:48:48.638 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-03-06T13:48:48.637+0000 7efc8307c200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-03-06T13:48:48.665 DEBUG:teuthology.orchestra.run.smithi202:> set -ex 2023-03-06T13:48:48.665 DEBUG:teuthology.orchestra.run.smithi202:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-03-06T13:48:48.691 DEBUG:teuthology.orchestra.run.smithi202:> set -ex 2023-03-06T13:48:48.692 DEBUG:teuthology.orchestra.run.smithi202:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-03-06T13:48:48.709 INFO:tasks.ceph.mgr.x.smithi202.stderr:2023-03-06T13:48:48.707+0000 7f1742eb7200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-03-06T13:48:48.722 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-03-06T13:48:48.720+0000 7efc8307c200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-03-06T13:48:48.734 DEBUG:teuthology.orchestra.run.smithi202:> set -ex 2023-03-06T13:48:48.734 DEBUG:teuthology.orchestra.run.smithi202:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-03-06T13:48:48.801 DEBUG:teuthology.orchestra.run.smithi202:> set -ex 2023-03-06T13:48:48.802 DEBUG:teuthology.orchestra.run.smithi202:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-03-06T13:48:48.861 INFO:tasks.ceph.mgr.x.smithi202.stderr:2023-03-06T13:48:48.860+0000 7f1742eb7200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-03-06T13:48:48.862 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-03-06T13:48:48.861+0000 7efc8307c200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-03-06T13:48:48.868 DEBUG:teuthology.orchestra.run.smithi202:> sudo ceph --cluster ceph osd new 2de68e69-e10f-49e1-a15a-8a9bfff504c1 0 2023-03-06T13:48:49.028 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.027+0000 7fa5a5ce5700 1 Processor -- start 2023-03-06T13:48:49.029 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.027+0000 7fa5a5ce5700 1 -- start start 2023-03-06T13:48:49.031 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.028+0000 7fa5a5ce5700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fa5a00c09a0 0x7fa5a014f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:48:49.031 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.028+0000 7fa5a5ce5700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5a00c0df0 con 0x7fa5a00bd670 2023-03-06T13:48:49.031 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.028+0000 7fa5a5ce5700 1 -- --> v1:172.21.15.202:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5a014fdb0 con 0x7fa5a014f930 2023-03-06T13:48:49.031 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.028+0000 7fa5a5ce5700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5a006d630 con 0x7fa5a00c09a0 2023-03-06T13:48:49.031 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.028+0000 7fa59ffff700 1 --1- >> v1:172.21.15.202:6789/0 conn(0x7fa5a014f930 0x7fa5a0159b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.202:6789/0 says I am v1:172.21.15.202:41032/0 (socket says 172.21.15.202:41032) 2023-03-06T13:48:49.032 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.028+0000 7fa59ffff700 1 -- 172.21.15.202:0/3276050673 learned_addr learned my addr 172.21.15.202:0/3276050673 (peer_addr_for_me v1:172.21.15.202:0/0) 2023-03-06T13:48:49.032 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.028+0000 7fa59effd700 1 --2- 172.21.15.202:0/3276050673 >> v2:172.21.15.86:3300/0 conn(0x7fa5a00c09a0 0x7fa5a014f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:48:49.032 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.028+0000 7fa59e7fc700 1 -- 172.21.15.202:0/3276050673 <== mon.1 v1:172.21.15.202:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2874722734 0 0) 0x7fa5a014fdb0 con 0x7fa5a014f930 2023-03-06T13:48:49.032 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.028+0000 7fa59e7fc700 1 -- 172.21.15.202:0/3276050673 --> v1:172.21.15.202:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa5880035b0 con 0x7fa5a014f930 2023-03-06T13:48:49.032 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.028+0000 7fa59effd700 1 -- 172.21.15.202:0/3276050673 >> v1:172.21.15.202:6789/0 conn(0x7fa5a014f930 legacy=0x7fa5a0159b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:48:49.032 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.028+0000 7fa59effd700 1 -- 172.21.15.202:0/3276050673 >> v1:172.21.15.86:6789/0 conn(0x7fa5a00bd670 legacy=0x7fa5a006d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:48:49.032 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.028+0000 7fa59e7fc700 1 -- 172.21.15.202:0/3276050673 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1822971366 0 0) 0x7fa5a00c0df0 con 0x7fa5a00bd670 2023-03-06T13:48:49.033 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.028+0000 7fa59effd700 1 -- 172.21.15.202:0/3276050673 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5a00c1060 con 0x7fa5a00c09a0 2023-03-06T13:48:49.033 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.028+0000 7fa59effd700 1 --2- 172.21.15.202:0/3276050673 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa5a00c09a0 0x7fa5a014f3f0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fa594009840 tx=0x7fa594009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3b0e10a944cc5c1 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T13:48:49.033 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.029+0000 7fa59e7fc700 1 -- 172.21.15.202:0/3276050673 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa594011830 con 0x7fa5a00c09a0 2023-03-06T13:48:49.033 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.029+0000 7fa59e7fc700 1 -- 172.21.15.202:0/3276050673 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa594011990 con 0x7fa5a00c09a0 2023-03-06T13:48:49.033 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.029+0000 7fa59e7fc700 1 -- 172.21.15.202:0/3276050673 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa594011d20 con 0x7fa5a00c09a0 2023-03-06T13:48:49.033 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.029+0000 7fa5a5ce5700 1 -- 172.21.15.202:0/3276050673 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa5a00c09a0 msgr2=0x7fa5a014f3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:48:49.033 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.029+0000 7fa5a5ce5700 1 --2- 172.21.15.202:0/3276050673 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa5a00c09a0 0x7fa5a014f3f0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fa594009840 tx=0x7fa594009b50 comp rx=0 tx=0).stop 2023-03-06T13:48:49.034 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.029+0000 7fa5a5ce5700 1 -- 172.21.15.202:0/3276050673 shutdown_connections 2023-03-06T13:48:49.034 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.029+0000 7fa5a5ce5700 1 --2- 172.21.15.202:0/3276050673 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa5a00c09a0 0x7fa5a014f3f0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:48:49.034 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.029+0000 7fa5a5ce5700 1 -- 172.21.15.202:0/3276050673 >> 172.21.15.202:0/3276050673 conn(0x7fa5a00c1900 msgr2=0x7fa5a00c1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T13:48:49.034 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.029+0000 7fa5a5ce5700 1 -- 172.21.15.202:0/3276050673 shutdown_connections 2023-03-06T13:48:49.034 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.029+0000 7fa5a5ce5700 1 -- 172.21.15.202:0/3276050673 wait complete. 2023-03-06T13:48:49.037 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.030+0000 7fa5a5ce5700 1 Processor -- start 2023-03-06T13:48:49.037 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.030+0000 7fa5a5ce5700 1 -- start start 2023-03-06T13:48:49.037 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.031+0000 7fa5a5ce5700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa5a00bd670 0x7fa5a01511e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:48:49.037 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.031+0000 7fa5a5ce5700 1 --2- >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fa5a00c09a0 0x7fa5a00a6cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:48:49.038 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.031+0000 7fa5a5ce5700 1 --2- >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7fa5a014f930 0x7fa5a01e7c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:48:49.038 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.031+0000 7fa5a5ce5700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5a0152750 con 0x7fa5a00bd670 2023-03-06T13:48:49.038 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.031+0000 7fa5a5ce5700 1 -- --> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5a0151720 con 0x7fa5a014f930 2023-03-06T13:48:49.038 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.031+0000 7fa5a5ce5700 1 -- --> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5a0150400 con 0x7fa5a00c09a0 2023-03-06T13:48:49.038 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.031+0000 7fa59effd700 1 --2- >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fa5a00c09a0 0x7fa5a00a6cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:48:49.038 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.031+0000 7fa59ffff700 1 --2- >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7fa5a014f930 0x7fa5a01e7c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:48:49.038 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.031+0000 7fa59effd700 1 --2- >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fa5a00c09a0 0x7fa5a00a6cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.202:3301/0 says I am v2:172.21.15.202:50136/0 (socket says 172.21.15.202:50136) 2023-03-06T13:48:49.038 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.031+0000 7fa59effd700 1 -- 172.21.15.202:0/2073053177 learned_addr learned my addr 172.21.15.202:0/2073053177 (peer_addr_for_me v2:172.21.15.202:0/0) 2023-03-06T13:48:49.039 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.031+0000 7fa59f7fe700 1 --2- 172.21.15.202:0/2073053177 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa5a00bd670 0x7fa5a01511e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:48:49.039 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.031+0000 7fa59effd700 1 -- 172.21.15.202:0/2073053177 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7fa5a014f930 msgr2=0x7fa5a01e7c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:48:49.039 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.031+0000 7fa59effd700 1 --2- 172.21.15.202:0/2073053177 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7fa5a014f930 0x7fa5a01e7c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:48:49.039 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.032+0000 7fa59effd700 1 -- 172.21.15.202:0/2073053177 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa5a00bd670 msgr2=0x7fa5a01511e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:48:49.039 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.032+0000 7fa59effd700 1 --2- 172.21.15.202:0/2073053177 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa5a00bd670 0x7fa5a01511e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:48:49.039 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.032+0000 7fa59effd700 1 -- 172.21.15.202:0/2073053177 --> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5940094a0 con 0x7fa5a00c09a0 2023-03-06T13:48:49.039 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.032+0000 7fa59ffff700 1 --2- 172.21.15.202:0/2073053177 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7fa5a014f930 0x7fa5a01e7c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-06T13:48:49.040 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.032+0000 7fa59effd700 1 --2- 172.21.15.202:0/2073053177 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fa5a00c09a0 0x7fa5a00a6cf0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fa5940090b0 tx=0x7fa594004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T13:48:49.040 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.032+0000 7fa587fff700 1 -- 172.21.15.202:0/2073053177 <== mon.2 v2:172.21.15.202:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa59401a7e0 con 0x7fa5a00c09a0 2023-03-06T13:48:49.040 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.032+0000 7fa587fff700 1 -- 172.21.15.202:0/2073053177 <== mon.2 v2:172.21.15.202:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa59401a940 con 0x7fa5a00c09a0 2023-03-06T13:48:49.040 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.032+0000 7fa5a5ce5700 1 -- 172.21.15.202:0/2073053177 --> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5a006cf70 con 0x7fa5a00c09a0 2023-03-06T13:48:49.040 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.032+0000 7fa587fff700 1 -- 172.21.15.202:0/2073053177 <== mon.2 v2:172.21.15.202:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa59401acd0 con 0x7fa5a00c09a0 2023-03-06T13:48:49.041 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.032+0000 7fa5a5ce5700 1 -- 172.21.15.202:0/2073053177 --> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5a006cc90 con 0x7fa5a00c09a0 2023-03-06T13:48:49.041 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.032+0000 7fa587fff700 1 -- 172.21.15.202:0/2073053177 <== mon.2 v2:172.21.15.202:3301/0 4 ==== mgrmap(e 1) v1 ==== 656+0+0 (secure 0 0 0) 0x7fa59402b030 con 0x7fa5a00c09a0 2023-03-06T13:48:49.041 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.032+0000 7fa587fff700 1 -- 172.21.15.202:0/2073053177 <== mon.2 v2:172.21.15.202:3301/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7fa59402ebc0 con 0x7fa5a00c09a0 2023-03-06T13:48:49.041 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.033+0000 7fa5a5ce5700 1 -- 172.21.15.202:0/2073053177 --> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5a006d250 con 0x7fa5a00c09a0 2023-03-06T13:48:49.041 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.035+0000 7fa587fff700 1 -- 172.21.15.202:0/2073053177 <== mon.2 v2:172.21.15.202:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7fa594029070 con 0x7fa5a00c09a0 2023-03-06T13:48:49.127 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.126+0000 7fa5a5ce5700 1 -- 172.21.15.202:0/2073053177 --> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] -- mon_command({"prefix": "osd new", "uuid": "2de68e69-e10f-49e1-a15a-8a9bfff504c1", "id": 0} v 0) v1 -- 0x7fa5a00a7230 con 0x7fa5a00c09a0 2023-03-06T13:48:49.136 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.134+0000 7fa587fff700 1 -- 172.21.15.202:0/2073053177 <== mon.2 v2:172.21.15.202:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "2de68e69-e10f-49e1-a15a-8a9bfff504c1", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7fa594015020 con 0x7fa5a00c09a0 2023-03-06T13:48:49.136 INFO:teuthology.orchestra.run.smithi202.stdout:0 2023-03-06T13:48:49.137 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.135+0000 7fa5a5ce5700 1 -- 172.21.15.202:0/2073053177 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fa5a00c09a0 msgr2=0x7fa5a00a6cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:48:49.137 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.135+0000 7fa5a5ce5700 1 --2- 172.21.15.202:0/2073053177 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fa5a00c09a0 0x7fa5a00a6cf0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fa5940090b0 tx=0x7fa594004750 comp rx=0 tx=0).stop 2023-03-06T13:48:49.137 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.135+0000 7fa5a5ce5700 1 -- 172.21.15.202:0/2073053177 shutdown_connections 2023-03-06T13:48:49.137 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.135+0000 7fa5a5ce5700 1 --2- 172.21.15.202:0/2073053177 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa5a00bd670 0x7fa5a01511e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:48:49.138 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.135+0000 7fa5a5ce5700 1 --2- 172.21.15.202:0/2073053177 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7fa5a014f930 0x7fa5a01e7c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:48:49.138 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.135+0000 7fa5a5ce5700 1 --2- 172.21.15.202:0/2073053177 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fa5a00c09a0 0x7fa5a00a6cf0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:48:49.138 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.135+0000 7fa5a5ce5700 1 -- 172.21.15.202:0/2073053177 >> 172.21.15.202:0/2073053177 conn(0x7fa5a00c1900 msgr2=0x7fa5a00c00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T13:48:49.138 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.135+0000 7fa5a5ce5700 1 -- 172.21.15.202:0/2073053177 shutdown_connections 2023-03-06T13:48:49.138 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.135+0000 7fa5a5ce5700 1 -- 172.21.15.202:0/2073053177 wait complete. 2023-03-06T13:48:49.149 DEBUG:teuthology.orchestra.run.smithi202:> sudo ceph --cluster ceph osd new 3e75c061-0de5-4742-a20d-4b5a4adb9b81 1 2023-03-06T13:48:49.268 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.266+0000 7fc1b30d8700 1 Processor -- start 2023-03-06T13:48:49.268 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.266+0000 7fc1b30d8700 1 -- start start 2023-03-06T13:48:49.269 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.267+0000 7fc1b30d8700 1 --2- >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fc1ac0c2860 0x7fc1ac0c2c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:48:49.270 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.267+0000 7fc1b30d8700 1 --2- >> v2:172.21.15.202:3300/0 conn(0x7fc1ac14fe60 0x7fc1ac156770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:48:49.270 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.267+0000 7fc1b30d8700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1ac146310 con 0x7fc1ac0bd220 2023-03-06T13:48:49.270 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.267+0000 7fc1b30d8700 1 -- --> v2:172.21.15.202:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1ac06d420 con 0x7fc1ac14fe60 2023-03-06T13:48:49.270 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.267+0000 7fc1b30d8700 1 -- --> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1ac14cc50 con 0x7fc1ac0c2860 2023-03-06T13:48:49.270 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.267+0000 7fc1b0e74700 1 --2- >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fc1ac0c2860 0x7fc1ac0c2c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:48:49.270 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.267+0000 7fc1b0e74700 1 --2- >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fc1ac0c2860 0x7fc1ac0c2c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.202:3301/0 says I am v2:172.21.15.202:50140/0 (socket says 172.21.15.202:50140) 2023-03-06T13:48:49.271 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.267+0000 7fc1b0e74700 1 -- 172.21.15.202:0/2428789428 learned_addr learned my addr 172.21.15.202:0/2428789428 (peer_addr_for_me v2:172.21.15.202:0/0) 2023-03-06T13:48:49.271 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.267+0000 7fc1b1675700 1 --2- 172.21.15.202:0/2428789428 >> v2:172.21.15.202:3300/0 conn(0x7fc1ac14fe60 0x7fc1ac156770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:48:49.271 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.268+0000 7fc1b1675700 1 -- 172.21.15.202:0/2428789428 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fc1ac0c2860 msgr2=0x7fc1ac0c2c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T13:48:49.271 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.268+0000 7fc1b1675700 1 --2- 172.21.15.202:0/2428789428 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fc1ac0c2860 0x7fc1ac0c2c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:48:49.271 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.268+0000 7fc1b1675700 1 -- 172.21.15.202:0/2428789428 >> v1:172.21.15.86:6789/0 conn(0x7fc1ac0bd220 legacy=0x7fc1ac14f750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:48:49.271 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.268+0000 7fc1b1675700 1 -- 172.21.15.202:0/2428789428 --> v2:172.21.15.202:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1ac0bd770 con 0x7fc1ac14fe60 2023-03-06T13:48:49.271 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.268+0000 7fc1b0e74700 1 --2- 172.21.15.202:0/2428789428 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fc1ac0c2860 0x7fc1ac0c2c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-06T13:48:49.272 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.268+0000 7fc1b1675700 1 --2- 172.21.15.202:0/2428789428 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7fc1ac14fe60 0x7fc1ac156770 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fc1a4009d90 tx=0x7fc1a400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bdca735575903c9 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T13:48:49.272 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.268+0000 7fc1ab7fe700 1 -- 172.21.15.202:0/2428789428 <== mon.1 v2:172.21.15.202:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1a400bd20 con 0x7fc1ac14fe60 2023-03-06T13:48:49.272 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.268+0000 7fc1ab7fe700 1 -- 172.21.15.202:0/2428789428 <== mon.1 v2:172.21.15.202:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1a400be80 con 0x7fc1ac14fe60 2023-03-06T13:48:49.272 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.268+0000 7fc1ab7fe700 1 -- 172.21.15.202:0/2428789428 <== mon.1 v2:172.21.15.202:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1a40116a0 con 0x7fc1ac14fe60 2023-03-06T13:48:49.275 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.269+0000 7fc1b30d8700 1 -- 172.21.15.202:0/2428789428 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7fc1ac14fe60 msgr2=0x7fc1ac156770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:48:49.275 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.269+0000 7fc1b30d8700 1 --2- 172.21.15.202:0/2428789428 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7fc1ac14fe60 0x7fc1ac156770 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fc1a4009d90 tx=0x7fc1a400b330 comp rx=0 tx=0).stop 2023-03-06T13:48:49.275 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.269+0000 7fc1b30d8700 1 -- 172.21.15.202:0/2428789428 shutdown_connections 2023-03-06T13:48:49.275 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.269+0000 7fc1b30d8700 1 --2- 172.21.15.202:0/2428789428 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7fc1ac14fe60 0x7fc1ac156770 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:48:49.275 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.269+0000 7fc1b30d8700 1 --2- 172.21.15.202:0/2428789428 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fc1ac0c2860 0x7fc1ac0c2c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:48:49.275 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.269+0000 7fc1b30d8700 1 -- 172.21.15.202:0/2428789428 >> 172.21.15.202:0/2428789428 conn(0x7fc1ac06c0d0 msgr2=0x7fc1ac0c2150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T13:48:49.276 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.269+0000 7fc1b30d8700 1 -- 172.21.15.202:0/2428789428 shutdown_connections 2023-03-06T13:48:49.276 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.269+0000 7fc1b30d8700 1 -- 172.21.15.202:0/2428789428 wait complete. 2023-03-06T13:48:49.276 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.270+0000 7fc1b30d8700 1 Processor -- start 2023-03-06T13:48:49.276 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.270+0000 7fc1b30d8700 1 -- start start 2023-03-06T13:48:49.276 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.271+0000 7fc1b30d8700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc1ac0bd220 0x7fc1ac146c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:48:49.277 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.271+0000 7fc1b30d8700 1 --2- >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7fc1ac0c2860 0x7fc1ac06a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:48:49.277 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.271+0000 7fc1b30d8700 1 --2- >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fc1ac14fe60 0x7fc1ac147800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:48:49.277 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.271+0000 7fc1b30d8700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1ac1471a0 con 0x7fc1ac0bd220 2023-03-06T13:48:49.277 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.271+0000 7fc1b30d8700 1 -- --> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1ac06aae0 con 0x7fc1ac0c2860 2023-03-06T13:48:49.277 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.271+0000 7fc1b30d8700 1 -- --> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1ac149ad0 con 0x7fc1ac14fe60 2023-03-06T13:48:49.277 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.271+0000 7fc1b1675700 1 --2- >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fc1ac14fe60 0x7fc1ac147800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:48:49.278 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.271+0000 7fc1abfff700 1 --2- >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7fc1ac0c2860 0x7fc1ac06a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:48:49.278 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.271+0000 7fc1b1675700 1 --2- >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fc1ac14fe60 0x7fc1ac147800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.202:3301/0 says I am v2:172.21.15.202:50148/0 (socket says 172.21.15.202:50148) 2023-03-06T13:48:49.278 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.271+0000 7fc1b1675700 1 -- 172.21.15.202:0/1619629006 learned_addr learned my addr 172.21.15.202:0/1619629006 (peer_addr_for_me v2:172.21.15.202:0/0) 2023-03-06T13:48:49.278 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.272+0000 7fc1b0e74700 1 --2- 172.21.15.202:0/1619629006 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc1ac0bd220 0x7fc1ac146c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:48:49.278 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.272+0000 7fc1b1675700 1 -- 172.21.15.202:0/1619629006 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7fc1ac0c2860 msgr2=0x7fc1ac06a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:48:49.278 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.272+0000 7fc1b1675700 1 --2- 172.21.15.202:0/1619629006 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7fc1ac0c2860 0x7fc1ac06a5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:48:49.278 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.272+0000 7fc1b1675700 1 -- 172.21.15.202:0/1619629006 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc1ac0bd220 msgr2=0x7fc1ac146c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:48:49.278 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.272+0000 7fc1b1675700 1 --2- 172.21.15.202:0/1619629006 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc1ac0bd220 0x7fc1ac146c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:48:49.279 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.272+0000 7fc1b1675700 1 -- 172.21.15.202:0/1619629006 --> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1a0009550 con 0x7fc1ac14fe60 2023-03-06T13:48:49.279 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.272+0000 7fc1abfff700 1 --2- 172.21.15.202:0/1619629006 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7fc1ac0c2860 0x7fc1ac06a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-06T13:48:49.279 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.272+0000 7fc1b1675700 1 --2- 172.21.15.202:0/1619629006 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fc1ac14fe60 0x7fc1ac147800 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fc1ac067d10 tx=0x7fc1a4004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T13:48:49.279 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.272+0000 7fc1a97fa700 1 -- 172.21.15.202:0/1619629006 <== mon.2 v2:172.21.15.202:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1a4020070 con 0x7fc1ac14fe60 2023-03-06T13:48:49.279 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.272+0000 7fc1a97fa700 1 -- 172.21.15.202:0/1619629006 <== mon.2 v2:172.21.15.202:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1a4004580 con 0x7fc1ac14fe60 2023-03-06T13:48:49.279 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.272+0000 7fc1b30d8700 1 -- 172.21.15.202:0/1619629006 --> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1a4009a70 con 0x7fc1ac14fe60 2023-03-06T13:48:49.280 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.272+0000 7fc1a97fa700 1 -- 172.21.15.202:0/1619629006 <== mon.2 v2:172.21.15.202:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1a4004910 con 0x7fc1ac14fe60 2023-03-06T13:48:49.280 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.272+0000 7fc1b30d8700 1 -- 172.21.15.202:0/1619629006 --> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1ac0bdd30 con 0x7fc1ac14fe60 2023-03-06T13:48:49.280 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.272+0000 7fc1a97fa700 1 -- 172.21.15.202:0/1619629006 <== mon.2 v2:172.21.15.202:3301/0 4 ==== mgrmap(e 1) v1 ==== 656+0+0 (secure 0 0 0) 0x7fc1a402b030 con 0x7fc1ac14fe60 2023-03-06T13:48:49.280 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.272+0000 7fc1a97fa700 1 -- 172.21.15.202:0/1619629006 <== mon.2 v2:172.21.15.202:3301/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7fc1a402e440 con 0x7fc1ac14fe60 2023-03-06T13:48:49.280 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.273+0000 7fc1b30d8700 1 -- 172.21.15.202:0/1619629006 --> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1ac0bda50 con 0x7fc1ac14fe60 2023-03-06T13:48:49.280 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.275+0000 7fc1a97fa700 1 -- 172.21.15.202:0/1619629006 <== mon.2 v2:172.21.15.202:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7fc1a4029070 con 0x7fc1ac14fe60 2023-03-06T13:48:49.360 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.358+0000 7fc1b30d8700 1 -- 172.21.15.202:0/1619629006 --> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] -- mon_command({"prefix": "osd new", "uuid": "3e75c061-0de5-4742-a20d-4b5a4adb9b81", "id": 1} v 0) v1 -- 0x7fc1ac0723b0 con 0x7fc1ac14fe60 2023-03-06T13:48:49.371 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.369+0000 7fc1a97fa700 1 -- 172.21.15.202:0/1619629006 <== mon.2 v2:172.21.15.202:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "3e75c061-0de5-4742-a20d-4b5a4adb9b81", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7fc1a400be20 con 0x7fc1ac14fe60 2023-03-06T13:48:49.371 INFO:teuthology.orchestra.run.smithi202.stdout:1 2023-03-06T13:48:49.372 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.370+0000 7fc1b30d8700 1 -- 172.21.15.202:0/1619629006 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fc1ac14fe60 msgr2=0x7fc1ac147800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:48:49.372 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.370+0000 7fc1b30d8700 1 --2- 172.21.15.202:0/1619629006 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fc1ac14fe60 0x7fc1ac147800 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fc1ac067d10 tx=0x7fc1a4004ad0 comp rx=0 tx=0).stop 2023-03-06T13:48:49.372 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.371+0000 7fc1b30d8700 1 -- 172.21.15.202:0/1619629006 shutdown_connections 2023-03-06T13:48:49.373 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.371+0000 7fc1b30d8700 1 --2- 172.21.15.202:0/1619629006 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc1ac0bd220 0x7fc1ac146c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:48:49.373 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.371+0000 7fc1b30d8700 1 --2- 172.21.15.202:0/1619629006 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fc1ac14fe60 0x7fc1ac147800 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:48:49.373 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.371+0000 7fc1b30d8700 1 --2- 172.21.15.202:0/1619629006 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7fc1ac0c2860 0x7fc1ac06a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:48:49.373 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.371+0000 7fc1b30d8700 1 -- 172.21.15.202:0/1619629006 >> 172.21.15.202:0/1619629006 conn(0x7fc1ac06c0d0 msgr2=0x7fc1ac06e630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T13:48:49.373 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.371+0000 7fc1b30d8700 1 -- 172.21.15.202:0/1619629006 shutdown_connections 2023-03-06T13:48:49.373 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.371+0000 7fc1b30d8700 1 -- 172.21.15.202:0/1619629006 wait complete. 2023-03-06T13:48:49.383 DEBUG:teuthology.orchestra.run.smithi202:> sudo ceph --cluster ceph osd new 38d71bce-81c2-4e33-91e1-65efb08f2291 2 2023-03-06T13:48:49.505 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.503+0000 7f30495f1700 1 Processor -- start 2023-03-06T13:48:49.505 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.503+0000 7f30495f1700 1 -- start start 2023-03-06T13:48:49.507 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.504+0000 7f30495f1700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f3044145700 0x7f304406daa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:48:49.507 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.504+0000 7f30495f1700 1 --2- >> v2:172.21.15.202:3300/0 conn(0x7f30440c11d0 0x7f304406cb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:48:49.507 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.504+0000 7f30495f1700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f304414b4e0 con 0x7f304406d050 2023-03-06T13:48:49.508 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.504+0000 7f30495f1700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f304414fae0 con 0x7f3044145700 2023-03-06T13:48:49.508 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.504+0000 7f30495f1700 1 -- --> v2:172.21.15.202:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30440bd330 con 0x7f30440c11d0 2023-03-06T13:48:49.508 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.504+0000 7f30427fc700 1 --2- >> v2:172.21.15.202:3300/0 conn(0x7f30440c11d0 0x7f304406cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:48:49.508 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.504+0000 7f30427fc700 1 --2- >> v2:172.21.15.202:3300/0 conn(0x7f30440c11d0 0x7f304406cb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.202:3300/0 says I am v2:172.21.15.202:35518/0 (socket says 172.21.15.202:35518) 2023-03-06T13:48:49.508 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.504+0000 7f30427fc700 1 -- 172.21.15.202:0/807413394 learned_addr learned my addr 172.21.15.202:0/807413394 (peer_addr_for_me v2:172.21.15.202:0/0) 2023-03-06T13:48:49.508 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.504+0000 7f3042ffd700 1 --2- 172.21.15.202:0/807413394 >> v2:172.21.15.86:3300/0 conn(0x7f3044145700 0x7f304406daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:48:49.508 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.505+0000 7f30427fc700 1 -- 172.21.15.202:0/807413394 >> v2:172.21.15.86:3300/0 conn(0x7f3044145700 msgr2=0x7f304406daa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T13:48:49.509 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.505+0000 7f30427fc700 1 --2- 172.21.15.202:0/807413394 >> v2:172.21.15.86:3300/0 conn(0x7f3044145700 0x7f304406daa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:48:49.509 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.505+0000 7f30427fc700 1 -- 172.21.15.202:0/807413394 >> v1:172.21.15.86:6789/0 conn(0x7f304406d050 legacy=0x7f304414bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:48:49.509 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.505+0000 7f30427fc700 1 -- 172.21.15.202:0/807413394 --> v2:172.21.15.202:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30440a0ed0 con 0x7f30440c11d0 2023-03-06T13:48:49.509 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.505+0000 7f30427fc700 1 --2- 172.21.15.202:0/807413394 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f30440c11d0 0x7f304406cb10 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f30440c1100 tx=0x7f3038009bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f17c35bb5d6a448a server_cookie=0 in_seq=0 out_seq=0 2023-03-06T13:48:49.509 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.505+0000 7f3041ffb700 1 -- 172.21.15.202:0/807413394 <== mon.1 v2:172.21.15.202:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3038011830 con 0x7f30440c11d0 2023-03-06T13:48:49.509 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.505+0000 7f3041ffb700 1 -- 172.21.15.202:0/807413394 <== mon.1 v2:172.21.15.202:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3038011990 con 0x7f30440c11d0 2023-03-06T13:48:49.509 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.505+0000 7f3041ffb700 1 -- 172.21.15.202:0/807413394 <== mon.1 v2:172.21.15.202:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3038011d20 con 0x7f30440c11d0 2023-03-06T13:48:49.509 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.505+0000 7f30495f1700 1 -- 172.21.15.202:0/807413394 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f30440c11d0 msgr2=0x7f304406cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:48:49.510 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.506+0000 7f30495f1700 1 --2- 172.21.15.202:0/807413394 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f30440c11d0 0x7f304406cb10 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f30440c1100 tx=0x7f3038009bd0 comp rx=0 tx=0).stop 2023-03-06T13:48:49.510 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.506+0000 7f30495f1700 1 -- 172.21.15.202:0/807413394 shutdown_connections 2023-03-06T13:48:49.510 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.506+0000 7f30495f1700 1 --2- 172.21.15.202:0/807413394 >> v2:172.21.15.86:3300/0 conn(0x7f3044145700 0x7f304406daa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:48:49.510 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.506+0000 7f30495f1700 1 --2- 172.21.15.202:0/807413394 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f30440c11d0 0x7f304406cb10 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:48:49.510 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.506+0000 7f30495f1700 1 -- 172.21.15.202:0/807413394 >> 172.21.15.202:0/807413394 conn(0x7f30440c1900 msgr2=0x7f30440c1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T13:48:49.510 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.506+0000 7f30495f1700 1 -- 172.21.15.202:0/807413394 shutdown_connections 2023-03-06T13:48:49.510 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.506+0000 7f30495f1700 1 -- 172.21.15.202:0/807413394 wait complete. 2023-03-06T13:48:49.512 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.507+0000 7f30495f1700 1 Processor -- start 2023-03-06T13:48:49.512 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.507+0000 7f30495f1700 1 -- start start 2023-03-06T13:48:49.512 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.507+0000 7f30495f1700 1 --2- >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f304406d050 0x7f30440baaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:48:49.513 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.508+0000 7f30495f1700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f30440c11d0 0x7f3044139100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:48:49.513 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.508+0000 7f30495f1700 1 --2- >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f3044145700 0x7f304414e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:48:49.513 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.508+0000 7f30495f1700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30440b96a0 con 0x7f30440c11d0 2023-03-06T13:48:49.513 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.508+0000 7f30495f1700 1 -- --> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f304414b090 con 0x7f304406d050 2023-03-06T13:48:49.513 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.508+0000 7f30495f1700 1 -- --> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3044139640 con 0x7f3044145700 2023-03-06T13:48:49.513 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.508+0000 7f30437fe700 1 --2- >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f3044145700 0x7f304414e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:48:49.513 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.508+0000 7f30437fe700 1 --2- >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f3044145700 0x7f304414e5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.202:3301/0 says I am v2:172.21.15.202:50158/0 (socket says 172.21.15.202:50158) 2023-03-06T13:48:49.514 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.508+0000 7f30437fe700 1 -- 172.21.15.202:0/347682083 learned_addr learned my addr 172.21.15.202:0/347682083 (peer_addr_for_me v2:172.21.15.202:0/0) 2023-03-06T13:48:49.514 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.508+0000 7f30427fc700 1 --2- 172.21.15.202:0/347682083 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f30440c11d0 0x7f3044139100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:48:49.514 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.508+0000 7f3042ffd700 1 --2- 172.21.15.202:0/347682083 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f304406d050 0x7f30440baaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:48:49.514 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.508+0000 7f30437fe700 1 -- 172.21.15.202:0/347682083 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f304406d050 msgr2=0x7f30440baaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:48:49.514 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.508+0000 7f30437fe700 1 --2- 172.21.15.202:0/347682083 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f304406d050 0x7f30440baaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:48:49.514 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.508+0000 7f30437fe700 1 -- 172.21.15.202:0/347682083 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f30440c11d0 msgr2=0x7f3044139100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:48:49.514 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.508+0000 7f30437fe700 1 --2- 172.21.15.202:0/347682083 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f30440c11d0 0x7f3044139100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:48:49.515 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.508+0000 7f30437fe700 1 -- 172.21.15.202:0/347682083 --> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3038009550 con 0x7f3044145700 2023-03-06T13:48:49.515 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.508+0000 7f30437fe700 1 --2- 172.21.15.202:0/347682083 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f3044145700 0x7f304414e5d0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f303c00cb50 tx=0x7f303c00ce60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T13:48:49.515 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.508+0000 7f302b7fe700 1 -- 172.21.15.202:0/347682083 <== mon.2 v2:172.21.15.202:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f303c003c00 con 0x7f3044145700 2023-03-06T13:48:49.515 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.508+0000 7f302b7fe700 1 -- 172.21.15.202:0/347682083 <== mon.2 v2:172.21.15.202:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f303c003d60 con 0x7f3044145700 2023-03-06T13:48:49.515 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.508+0000 7f30495f1700 1 -- 172.21.15.202:0/347682083 --> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f304414b7a0 con 0x7f3044145700 2023-03-06T13:48:49.515 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.508+0000 7f302b7fe700 1 -- 172.21.15.202:0/347682083 <== mon.2 v2:172.21.15.202:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f303c00aa20 con 0x7f3044145700 2023-03-06T13:48:49.515 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.508+0000 7f30495f1700 1 -- 172.21.15.202:0/347682083 --> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30440a11b0 con 0x7f3044145700 2023-03-06T13:48:49.515 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.509+0000 7f302b7fe700 1 -- 172.21.15.202:0/347682083 <== mon.2 v2:172.21.15.202:3301/0 4 ==== mgrmap(e 1) v1 ==== 656+0+0 (secure 0 0 0) 0x7f303c010050 con 0x7f3044145700 2023-03-06T13:48:49.516 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.509+0000 7f302b7fe700 1 -- 172.21.15.202:0/347682083 <== mon.2 v2:172.21.15.202:3301/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7f303c012840 con 0x7f3044145700 2023-03-06T13:48:49.516 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.509+0000 7f30495f1700 1 -- 172.21.15.202:0/347682083 --> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f304414c3d0 con 0x7f3044145700 2023-03-06T13:48:49.516 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.511+0000 7f302b7fe700 1 -- 172.21.15.202:0/347682083 <== mon.2 v2:172.21.15.202:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7f303c012420 con 0x7f3044145700 2023-03-06T13:48:49.536 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-03-06T13:48:49.535+0000 7efc8307c200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-03-06T13:48:49.581 INFO:tasks.ceph.mgr.x.smithi202.stderr:2023-03-06T13:48:49.580+0000 7f1742eb7200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-03-06T13:48:49.594 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.593+0000 7f30495f1700 1 -- 172.21.15.202:0/347682083 --> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] -- mon_command({"prefix": "osd new", "uuid": "38d71bce-81c2-4e33-91e1-65efb08f2291", "id": 2} v 0) v1 -- 0x7f304404e750 con 0x7f3044145700 2023-03-06T13:48:49.602 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.600+0000 7f302b7fe700 1 -- 172.21.15.202:0/347682083 <== mon.2 v2:172.21.15.202:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "38d71bce-81c2-4e33-91e1-65efb08f2291", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f303c0126a0 con 0x7f3044145700 2023-03-06T13:48:49.602 INFO:teuthology.orchestra.run.smithi202.stdout:2 2023-03-06T13:48:49.603 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.601+0000 7f30495f1700 1 -- 172.21.15.202:0/347682083 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f3044145700 msgr2=0x7f304414e5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:48:49.603 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.601+0000 7f30495f1700 1 --2- 172.21.15.202:0/347682083 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f3044145700 0x7f304414e5d0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f303c00cb50 tx=0x7f303c00ce60 comp rx=0 tx=0).stop 2023-03-06T13:48:49.603 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.602+0000 7f30495f1700 1 -- 172.21.15.202:0/347682083 shutdown_connections 2023-03-06T13:48:49.603 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.602+0000 7f30495f1700 1 --2- 172.21.15.202:0/347682083 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f3044145700 0x7f304414e5d0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:48:49.604 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.602+0000 7f30495f1700 1 --2- 172.21.15.202:0/347682083 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f304406d050 0x7f30440baaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:48:49.604 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.602+0000 7f30495f1700 1 --2- 172.21.15.202:0/347682083 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f30440c11d0 0x7f3044139100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:48:49.604 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.602+0000 7f30495f1700 1 -- 172.21.15.202:0/347682083 >> 172.21.15.202:0/347682083 conn(0x7f30440c1900 msgr2=0x7f30440a20a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T13:48:49.604 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.602+0000 7f30495f1700 1 -- 172.21.15.202:0/347682083 shutdown_connections 2023-03-06T13:48:49.604 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.602+0000 7f30495f1700 1 -- 172.21.15.202:0/347682083 wait complete. 2023-03-06T13:48:49.611 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-03-06T13:48:49.610+0000 7efc8307c200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-03-06T13:48:49.615 DEBUG:teuthology.orchestra.run.smithi202:> sudo ceph --cluster ceph osd new d95a2686-21bd-4b66-9ea5-eef65403935b 3 2023-03-06T13:48:49.661 INFO:tasks.ceph.mgr.x.smithi202.stderr:2023-03-06T13:48:49.659+0000 7f1742eb7200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-03-06T13:48:49.690 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-03-06T13:48:49.688+0000 7efc8307c200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-03-06T13:48:49.733 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.732+0000 7f9bf5bee700 1 Processor -- start 2023-03-06T13:48:49.734 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.732+0000 7f9bf5bee700 1 -- start start 2023-03-06T13:48:49.735 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.732+0000 7f9bf5bee700 1 --2- >> v2:172.21.15.202:3300/0 conn(0x7f9bf00c2860 0x7f9bf00c2c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:48:49.736 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.732+0000 7f9bf5bee700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f9bf014fe60 0x7f9bf0156770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:48:49.736 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.733+0000 7f9bf5bee700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9bf0146310 con 0x7f9bf00bd220 2023-03-06T13:48:49.736 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.733+0000 7f9bf5bee700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9bf006d420 con 0x7f9bf014fe60 2023-03-06T13:48:49.736 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.733+0000 7f9bf5bee700 1 -- --> v2:172.21.15.202:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9bf014cc50 con 0x7f9bf00c2860 2023-03-06T13:48:49.736 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.733+0000 7f9bef7fe700 1 --2- >> v2:172.21.15.202:3300/0 conn(0x7f9bf00c2860 0x7f9bf00c2c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:48:49.736 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.733+0000 7f9bef7fe700 1 --2- >> v2:172.21.15.202:3300/0 conn(0x7f9bf00c2860 0x7f9bf00c2c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.202:3300/0 says I am v2:172.21.15.202:35528/0 (socket says 172.21.15.202:35528) 2023-03-06T13:48:49.736 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.733+0000 7f9bef7fe700 1 -- 172.21.15.202:0/599183308 learned_addr learned my addr 172.21.15.202:0/599183308 (peer_addr_for_me v2:172.21.15.202:0/0) 2023-03-06T13:48:49.737 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.733+0000 7f9beffff700 1 --2- 172.21.15.202:0/599183308 >> v2:172.21.15.86:3300/0 conn(0x7f9bf014fe60 0x7f9bf0156770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:48:49.737 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.733+0000 7f9bef7fe700 1 -- 172.21.15.202:0/599183308 >> v2:172.21.15.86:3300/0 conn(0x7f9bf014fe60 msgr2=0x7f9bf0156770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T13:48:49.737 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.733+0000 7f9bef7fe700 1 --2- 172.21.15.202:0/599183308 >> v2:172.21.15.86:3300/0 conn(0x7f9bf014fe60 0x7f9bf0156770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:48:49.737 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.733+0000 7f9bef7fe700 1 -- 172.21.15.202:0/599183308 >> v1:172.21.15.86:6789/0 conn(0x7f9bf00bd220 legacy=0x7f9bf014f750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:48:49.737 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.733+0000 7f9bef7fe700 1 -- 172.21.15.202:0/599183308 --> v2:172.21.15.202:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bf00bd770 con 0x7f9bf00c2860 2023-03-06T13:48:49.737 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.733+0000 7f9bef7fe700 1 --2- 172.21.15.202:0/599183308 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f9bf00c2860 0x7f9bf00c2c30 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f9bf00676e0 tx=0x7f9be000be70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f661fe165d5cc4de server_cookie=0 in_seq=0 out_seq=0 2023-03-06T13:48:49.737 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.733+0000 7f9bee7fc700 1 -- 172.21.15.202:0/599183308 <== mon.1 v2:172.21.15.202:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9be000dd30 con 0x7f9bf00c2860 2023-03-06T13:48:49.738 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.733+0000 7f9bee7fc700 1 -- 172.21.15.202:0/599183308 <== mon.1 v2:172.21.15.202:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9be000de90 con 0x7f9bf00c2860 2023-03-06T13:48:49.738 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.733+0000 7f9bee7fc700 1 -- 172.21.15.202:0/599183308 <== mon.1 v2:172.21.15.202:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9be0010690 con 0x7f9bf00c2860 2023-03-06T13:48:49.738 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.734+0000 7f9bf5bee700 1 -- 172.21.15.202:0/599183308 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f9bf00c2860 msgr2=0x7f9bf00c2c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:48:49.738 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.734+0000 7f9bf5bee700 1 --2- 172.21.15.202:0/599183308 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f9bf00c2860 0x7f9bf00c2c30 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f9bf00676e0 tx=0x7f9be000be70 comp rx=0 tx=0).stop 2023-03-06T13:48:49.738 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.734+0000 7f9bf5bee700 1 -- 172.21.15.202:0/599183308 shutdown_connections 2023-03-06T13:48:49.738 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.734+0000 7f9bf5bee700 1 --2- 172.21.15.202:0/599183308 >> v2:172.21.15.86:3300/0 conn(0x7f9bf014fe60 0x7f9bf0156770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:48:49.738 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.734+0000 7f9bf5bee700 1 --2- 172.21.15.202:0/599183308 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f9bf00c2860 0x7f9bf00c2c30 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:48:49.739 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.734+0000 7f9bf5bee700 1 -- 172.21.15.202:0/599183308 >> 172.21.15.202:0/599183308 conn(0x7f9bf006c0d0 msgr2=0x7f9bf00c2150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T13:48:49.739 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.734+0000 7f9bf5bee700 1 -- 172.21.15.202:0/599183308 shutdown_connections 2023-03-06T13:48:49.739 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.734+0000 7f9bf5bee700 1 -- 172.21.15.202:0/599183308 wait complete. 2023-03-06T13:48:49.741 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.735+0000 7f9bf5bee700 1 Processor -- start 2023-03-06T13:48:49.741 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.735+0000 7f9bf5bee700 1 -- start start 2023-03-06T13:48:49.741 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.736+0000 7f9bf5bee700 1 --2- >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f9bf00bd220 0x7f9bf00c1980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:48:49.741 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.736+0000 7f9bf5bee700 1 --2- >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f9bf00c2860 0x7f9bf01e0790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:48:49.742 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.736+0000 7f9bf5bee700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9bf014fe60 0x7f9bf01e0cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:48:49.742 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.736+0000 7f9bf5bee700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bf014f010 con 0x7f9bf014fe60 2023-03-06T13:48:49.742 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.736+0000 7f9bf5bee700 1 -- --> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bf014ea30 con 0x7f9bf00bd220 2023-03-06T13:48:49.742 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.736+0000 7f9bf5bee700 1 -- --> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bf00c1ec0 con 0x7f9bf00c2860 2023-03-06T13:48:49.742 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.736+0000 7f9bef7fe700 1 --2- >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f9bf00bd220 0x7f9bf00c1980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:48:49.743 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.736+0000 7f9bef7fe700 1 --2- >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f9bf00bd220 0x7f9bf00c1980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.202:3300/0 says I am v2:172.21.15.202:35534/0 (socket says 172.21.15.202:35534) 2023-03-06T13:48:49.743 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.736+0000 7f9bef7fe700 1 -- 172.21.15.202:0/1443874908 learned_addr learned my addr 172.21.15.202:0/1443874908 (peer_addr_for_me v2:172.21.15.202:0/0) 2023-03-06T13:48:49.743 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.736+0000 7f9beeffd700 1 --2- 172.21.15.202:0/1443874908 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f9bf00c2860 0x7f9bf01e0790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:48:49.743 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.736+0000 7f9beffff700 1 --2- 172.21.15.202:0/1443874908 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9bf014fe60 0x7f9bf01e0cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:48:49.743 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.736+0000 7f9bef7fe700 1 -- 172.21.15.202:0/1443874908 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f9bf00c2860 msgr2=0x7f9bf01e0790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:48:49.743 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.736+0000 7f9bef7fe700 1 --2- 172.21.15.202:0/1443874908 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f9bf00c2860 0x7f9bf01e0790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:48:49.744 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.736+0000 7f9bef7fe700 1 -- 172.21.15.202:0/1443874908 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9bf014fe60 msgr2=0x7f9bf01e0cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:48:49.744 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.736+0000 7f9bef7fe700 1 --2- 172.21.15.202:0/1443874908 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9bf014fe60 0x7f9bf01e0cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:48:49.744 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.736+0000 7f9bef7fe700 1 -- 172.21.15.202:0/1443874908 --> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9be000b7f0 con 0x7f9bf00bd220 2023-03-06T13:48:49.744 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.736+0000 7f9beffff700 1 --2- 172.21.15.202:0/1443874908 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9bf014fe60 0x7f9bf01e0cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-06T13:48:49.744 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.736+0000 7f9bef7fe700 1 --2- 172.21.15.202:0/1443874908 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f9bf00bd220 0x7f9bf00c1980 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f9be0000c00 tx=0x7f9be0004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T13:48:49.744 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.736+0000 7f9bd7fff700 1 -- 172.21.15.202:0/1443874908 <== mon.1 v2:172.21.15.202:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9be001f070 con 0x7f9bf00bd220 2023-03-06T13:48:49.744 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.736+0000 7f9bd7fff700 1 -- 172.21.15.202:0/1443874908 <== mon.1 v2:172.21.15.202:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9be0003a70 con 0x7f9bf00bd220 2023-03-06T13:48:49.744 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.736+0000 7f9bf5bee700 1 -- 172.21.15.202:0/1443874908 --> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9bf00bdd30 con 0x7f9bf00bd220 2023-03-06T13:48:49.745 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.736+0000 7f9bd7fff700 1 -- 172.21.15.202:0/1443874908 <== mon.1 v2:172.21.15.202:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9be0003e20 con 0x7f9bf00bd220 2023-03-06T13:48:49.745 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.736+0000 7f9bf5bee700 1 -- 172.21.15.202:0/1443874908 --> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9bf00bda50 con 0x7f9bf00bd220 2023-03-06T13:48:49.745 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.736+0000 7f9bd7fff700 1 -- 172.21.15.202:0/1443874908 <== mon.1 v2:172.21.15.202:3300/0 4 ==== mgrmap(e 1) v1 ==== 656+0+0 (secure 0 0 0) 0x7f9be0010760 con 0x7f9bf00bd220 2023-03-06T13:48:49.745 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.736+0000 7f9bd7fff700 1 -- 172.21.15.202:0/1443874908 <== mon.1 v2:172.21.15.202:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7f9be0019890 con 0x7f9bf00bd220 2023-03-06T13:48:49.745 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.737+0000 7f9bf5bee700 1 -- 172.21.15.202:0/1443874908 --> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9bf00723b0 con 0x7f9bf00bd220 2023-03-06T13:48:49.745 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.739+0000 7f9bd7fff700 1 -- 172.21.15.202:0/1443874908 <== mon.1 v2:172.21.15.202:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7f9be0028070 con 0x7f9bf00bd220 2023-03-06T13:48:49.754 INFO:tasks.ceph.mgr.x.smithi202.stderr:2023-03-06T13:48:49.753+0000 7f1742eb7200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-03-06T13:48:49.824 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-03-06T13:48:49.822+0000 7efc8307c200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-03-06T13:48:49.837 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.836+0000 7f9bf5bee700 1 -- 172.21.15.202:0/1443874908 --> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] -- mon_command({"prefix": "osd new", "uuid": "d95a2686-21bd-4b66-9ea5-eef65403935b", "id": 3} v 0) v1 -- 0x7f9bf004e750 con 0x7f9bf00bd220 2023-03-06T13:48:49.840 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.839+0000 7f9bd7fff700 1 -- 172.21.15.202:0/1443874908 <== mon.1 v2:172.21.15.202:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d95a2686-21bd-4b66-9ea5-eef65403935b", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f9be0010bd0 con 0x7f9bf00bd220 2023-03-06T13:48:49.841 INFO:teuthology.orchestra.run.smithi202.stdout:3 2023-03-06T13:48:49.843 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.840+0000 7f9bf5bee700 1 -- 172.21.15.202:0/1443874908 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f9bf00bd220 msgr2=0x7f9bf00c1980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:48:49.844 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.840+0000 7f9bf5bee700 1 --2- 172.21.15.202:0/1443874908 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f9bf00bd220 0x7f9bf00c1980 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f9be0000c00 tx=0x7f9be0004750 comp rx=0 tx=0).stop 2023-03-06T13:48:49.844 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.840+0000 7f9bf5bee700 1 -- 172.21.15.202:0/1443874908 shutdown_connections 2023-03-06T13:48:49.844 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.840+0000 7f9bf5bee700 1 --2- 172.21.15.202:0/1443874908 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9bf014fe60 0x7f9bf01e0cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:48:49.844 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.840+0000 7f9bf5bee700 1 --2- 172.21.15.202:0/1443874908 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f9bf00bd220 0x7f9bf00c1980 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:48:49.845 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.840+0000 7f9bf5bee700 1 --2- 172.21.15.202:0/1443874908 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f9bf00c2860 0x7f9bf01e0790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:48:49.845 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.840+0000 7f9bf5bee700 1 -- 172.21.15.202:0/1443874908 >> 172.21.15.202:0/1443874908 conn(0x7f9bf006c0d0 msgr2=0x7f9bf014b460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T13:48:49.845 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.840+0000 7f9bf5bee700 1 -- 172.21.15.202:0/1443874908 shutdown_connections 2023-03-06T13:48:49.845 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.840+0000 7f9bf5bee700 1 -- 172.21.15.202:0/1443874908 wait complete. 2023-03-06T13:48:49.854 DEBUG:teuthology.orchestra.run.smithi202:> sudo ceph --cluster ceph osd new 98c7e359-0f00-496a-8aaa-5472af355e48 4 2023-03-06T13:48:49.905 INFO:tasks.ceph.mgr.x.smithi202.stderr:2023-03-06T13:48:49.903+0000 7f1742eb7200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-03-06T13:48:49.975 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.974+0000 7fe2dde10700 1 Processor -- start 2023-03-06T13:48:49.976 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.974+0000 7fe2dde10700 1 -- start start 2023-03-06T13:48:49.979 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.974+0000 7fe2dde10700 1 --2- >> v2:172.21.15.202:3300/0 conn(0x7fe2d8149420 0x7fe2d80c2860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:48:49.983 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.974+0000 7fe2dde10700 1 --2- >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fe2d806ea90 0x7fe2d8159a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:48:49.983 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.974+0000 7fe2dde10700 1 -- --> v1:172.21.15.202:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2d8153340 con 0x7fe2d80c2da0 2023-03-06T13:48:49.983 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.974+0000 7fe2dde10700 1 -- --> v2:172.21.15.202:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2d81497f0 con 0x7fe2d8149420 2023-03-06T13:48:49.984 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.974+0000 7fe2dde10700 1 -- --> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2d8152750 con 0x7fe2d806ea90 2023-03-06T13:48:49.984 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.974+0000 7fe2d77fe700 1 --2- >> v2:172.21.15.202:3300/0 conn(0x7fe2d8149420 0x7fe2d80c2860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:48:49.984 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.974+0000 7fe2d6ffd700 1 --1- >> v1:172.21.15.202:6789/0 conn(0x7fe2d80c2da0 0x7fe2d814f0c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.202:6789/0 says I am v1:172.21.15.202:41072/0 (socket says 172.21.15.202:41072) 2023-03-06T13:48:49.985 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.975+0000 7fe2d77fe700 1 --2- >> v2:172.21.15.202:3300/0 conn(0x7fe2d8149420 0x7fe2d80c2860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.202:3300/0 says I am v2:172.21.15.202:35540/0 (socket says 172.21.15.202:35540) 2023-03-06T13:48:49.985 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.975+0000 7fe2d6ffd700 1 -- 172.21.15.202:0/837887150 learned_addr learned my addr 172.21.15.202:0/837887150 (peer_addr_for_me v1:172.21.15.202:0/0) 2023-03-06T13:48:49.985 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.975+0000 7fe2d7fff700 1 --2- 172.21.15.202:0/837887150 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fe2d806ea90 0x7fe2d8159a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:48:49.986 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.975+0000 7fe2d7fff700 1 -- 172.21.15.202:0/837887150 >> v2:172.21.15.202:3300/0 conn(0x7fe2d8149420 msgr2=0x7fe2d80c2860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T13:48:49.986 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.975+0000 7fe2d7fff700 1 --2- 172.21.15.202:0/837887150 >> v2:172.21.15.202:3300/0 conn(0x7fe2d8149420 0x7fe2d80c2860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:48:49.986 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.975+0000 7fe2d7fff700 1 -- 172.21.15.202:0/837887150 >> v1:172.21.15.202:6789/0 conn(0x7fe2d80c2da0 legacy=0x7fe2d814f0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:48:49.987 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.975+0000 7fe2d67fc700 1 -- 172.21.15.202:0/837887150 <== mon.1 v1:172.21.15.202:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3947597824 0 0) 0x7fe2d8153340 con 0x7fe2d80c2da0 2023-03-06T13:48:49.987 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.975+0000 7fe2d7fff700 1 -- 172.21.15.202:0/837887150 --> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2d8152a10 con 0x7fe2d806ea90 2023-03-06T13:48:49.987 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.975+0000 7fe2d77fe700 1 --2- 172.21.15.202:0/837887150 >> v2:172.21.15.202:3300/0 conn(0x7fe2d8149420 0x7fe2d80c2860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-06T13:48:49.987 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.975+0000 7fe2d7fff700 1 --2- 172.21.15.202:0/837887150 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fe2d806ea90 0x7fe2d8159a40 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fe2d0009d90 tx=0x7fe2d000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=642574989d7f6c8d server_cookie=0 in_seq=0 out_seq=0 2023-03-06T13:48:49.988 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.975+0000 7fe2d67fc700 1 -- 172.21.15.202:0/837887150 <== mon.2 v2:172.21.15.202:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2d000e070 con 0x7fe2d806ea90 2023-03-06T13:48:49.988 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.975+0000 7fe2d67fc700 1 -- 172.21.15.202:0/837887150 <== mon.2 v2:172.21.15.202:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2d000bb20 con 0x7fe2d806ea90 2023-03-06T13:48:49.988 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.975+0000 7fe2d67fc700 1 -- 172.21.15.202:0/837887150 <== mon.2 v2:172.21.15.202:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2d0012430 con 0x7fe2d806ea90 2023-03-06T13:48:49.988 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.976+0000 7fe2dde10700 1 -- 172.21.15.202:0/837887150 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fe2d806ea90 msgr2=0x7fe2d8159a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:48:49.989 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.976+0000 7fe2dde10700 1 --2- 172.21.15.202:0/837887150 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fe2d806ea90 0x7fe2d8159a40 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fe2d0009d90 tx=0x7fe2d000b330 comp rx=0 tx=0).stop 2023-03-06T13:48:49.989 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.976+0000 7fe2dde10700 1 -- 172.21.15.202:0/837887150 shutdown_connections 2023-03-06T13:48:49.989 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.976+0000 7fe2dde10700 1 --2- 172.21.15.202:0/837887150 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fe2d806ea90 0x7fe2d8159a40 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:48:49.990 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.976+0000 7fe2dde10700 1 --2- 172.21.15.202:0/837887150 >> v2:172.21.15.202:3300/0 conn(0x7fe2d8149420 0x7fe2d80c2860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:48:49.990 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.976+0000 7fe2dde10700 1 -- 172.21.15.202:0/837887150 >> 172.21.15.202:0/837887150 conn(0x7fe2d806c0d0 msgr2=0x7fe2d80c2150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T13:48:49.990 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.976+0000 7fe2dde10700 1 -- 172.21.15.202:0/837887150 shutdown_connections 2023-03-06T13:48:49.990 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.976+0000 7fe2dde10700 1 -- 172.21.15.202:0/837887150 wait complete. 2023-03-06T13:48:49.991 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.977+0000 7fe2dde10700 1 Processor -- start 2023-03-06T13:48:49.991 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.978+0000 7fe2dde10700 1 -- start start 2023-03-06T13:48:49.993 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.978+0000 7fe2dde10700 1 --2- >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fe2d806ea90 0x7fe2d80c1c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:48:49.993 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.978+0000 7fe2dde10700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe2d80c2da0 0x7fe2d81e80d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:48:49.993 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.978+0000 7fe2dde10700 1 --2- >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7fe2d8149420 0x7fe2d81e8610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:48:49.993 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.978+0000 7fe2dde10700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2d814b360 con 0x7fe2d80c2da0 2023-03-06T13:48:49.994 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.978+0000 7fe2dde10700 1 -- --> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2d81e7c40 con 0x7fe2d8149420 2023-03-06T13:48:49.994 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.978+0000 7fe2dde10700 1 -- --> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2d80c2190 con 0x7fe2d806ea90 2023-03-06T13:48:49.994 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.978+0000 7fe2d77fe700 1 --2- >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fe2d806ea90 0x7fe2d80c1c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:48:49.994 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.979+0000 7fe2d7fff700 1 --2- >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7fe2d8149420 0x7fe2d81e8610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:48:49.994 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.979+0000 7fe2d77fe700 1 --2- >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fe2d806ea90 0x7fe2d80c1c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.202:3301/0 says I am v2:172.21.15.202:50178/0 (socket says 172.21.15.202:50178) 2023-03-06T13:48:49.994 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.979+0000 7fe2d77fe700 1 -- 172.21.15.202:0/1598103525 learned_addr learned my addr 172.21.15.202:0/1598103525 (peer_addr_for_me v2:172.21.15.202:0/0) 2023-03-06T13:48:49.994 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.979+0000 7fe2d6ffd700 1 --2- 172.21.15.202:0/1598103525 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe2d80c2da0 0x7fe2d81e80d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:48:49.995 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.979+0000 7fe2d7fff700 1 -- 172.21.15.202:0/1598103525 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fe2d806ea90 msgr2=0x7fe2d80c1c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:48:49.995 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.979+0000 7fe2d7fff700 1 --2- 172.21.15.202:0/1598103525 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fe2d806ea90 0x7fe2d80c1c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:48:49.995 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.979+0000 7fe2d7fff700 1 -- 172.21.15.202:0/1598103525 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe2d80c2da0 msgr2=0x7fe2d81e80d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:48:49.995 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.979+0000 7fe2d7fff700 1 --2- 172.21.15.202:0/1598103525 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe2d80c2da0 0x7fe2d81e80d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:48:49.995 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.979+0000 7fe2d7fff700 1 -- 172.21.15.202:0/1598103525 --> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2c80094a0 con 0x7fe2d8149420 2023-03-06T13:48:49.995 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.979+0000 7fe2d77fe700 1 --2- 172.21.15.202:0/1598103525 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fe2d806ea90 0x7fe2d80c1c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-06T13:48:49.995 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.979+0000 7fe2d7fff700 1 --2- 172.21.15.202:0/1598103525 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7fe2d8149420 0x7fe2d81e8610 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fe2d0016000 tx=0x7fe2d0004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T13:48:49.996 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.979+0000 7fe2bffff700 1 -- 172.21.15.202:0/1598103525 <== mon.1 v2:172.21.15.202:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2d0012430 con 0x7fe2d8149420 2023-03-06T13:48:49.996 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.979+0000 7fe2bffff700 1 -- 172.21.15.202:0/1598103525 <== mon.1 v2:172.21.15.202:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2d0020070 con 0x7fe2d8149420 2023-03-06T13:48:49.996 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.979+0000 7fe2dde10700 1 -- 172.21.15.202:0/1598103525 --> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2d0009a70 con 0x7fe2d8149420 2023-03-06T13:48:49.996 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.979+0000 7fe2bffff700 1 -- 172.21.15.202:0/1598103525 <== mon.1 v2:172.21.15.202:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2d00098f0 con 0x7fe2d8149420 2023-03-06T13:48:49.996 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.979+0000 7fe2dde10700 1 -- 172.21.15.202:0/1598103525 --> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2d8152fd0 con 0x7fe2d8149420 2023-03-06T13:48:49.996 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.980+0000 7fe2bffff700 1 -- 172.21.15.202:0/1598103525 <== mon.1 v2:172.21.15.202:3300/0 4 ==== mgrmap(e 1) v1 ==== 656+0+0 (secure 0 0 0) 0x7fe2d002e070 con 0x7fe2d8149420 2023-03-06T13:48:49.996 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.980+0000 7fe2bffff700 1 -- 172.21.15.202:0/1598103525 <== mon.1 v2:172.21.15.202:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7fe2d0022070 con 0x7fe2d8149420 2023-03-06T13:48:49.997 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.980+0000 7fe2dde10700 1 -- 172.21.15.202:0/1598103525 --> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2d8152cf0 con 0x7fe2d8149420 2023-03-06T13:48:49.997 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:49.983+0000 7fe2bffff700 1 -- 172.21.15.202:0/1598103525 <== mon.1 v2:172.21.15.202:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7fe2d002c060 con 0x7fe2d8149420 2023-03-06T13:48:50.069 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:50.068+0000 7fe2dde10700 1 -- 172.21.15.202:0/1598103525 --> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] -- mon_command({"prefix": "osd new", "uuid": "98c7e359-0f00-496a-8aaa-5472af355e48", "id": 4} v 0) v1 -- 0x7fe2d806e610 con 0x7fe2d8149420 2023-03-06T13:48:50.073 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:50.071+0000 7fe2bffff700 1 -- 172.21.15.202:0/1598103525 <== mon.1 v2:172.21.15.202:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "98c7e359-0f00-496a-8aaa-5472af355e48", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7fe2d0004330 con 0x7fe2d8149420 2023-03-06T13:48:50.073 INFO:teuthology.orchestra.run.smithi202.stdout:4 2023-03-06T13:48:50.074 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:50.072+0000 7fe2dde10700 1 -- 172.21.15.202:0/1598103525 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7fe2d8149420 msgr2=0x7fe2d81e8610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:48:50.074 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:50.072+0000 7fe2dde10700 1 --2- 172.21.15.202:0/1598103525 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7fe2d8149420 0x7fe2d81e8610 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fe2d0016000 tx=0x7fe2d0004ad0 comp rx=0 tx=0).stop 2023-03-06T13:48:50.074 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:50.072+0000 7fe2dde10700 1 -- 172.21.15.202:0/1598103525 shutdown_connections 2023-03-06T13:48:50.075 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:50.072+0000 7fe2dde10700 1 --2- 172.21.15.202:0/1598103525 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7fe2d8149420 0x7fe2d81e8610 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:48:50.075 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:50.072+0000 7fe2dde10700 1 --2- 172.21.15.202:0/1598103525 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fe2d806ea90 0x7fe2d80c1c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:48:50.075 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:50.072+0000 7fe2dde10700 1 --2- 172.21.15.202:0/1598103525 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe2d80c2da0 0x7fe2d81e80d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:48:50.075 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:50.072+0000 7fe2dde10700 1 -- 172.21.15.202:0/1598103525 >> 172.21.15.202:0/1598103525 conn(0x7fe2d806c0d0 msgr2=0x7fe2d80bee30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T13:48:50.075 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:50.073+0000 7fe2dde10700 1 -- 172.21.15.202:0/1598103525 shutdown_connections 2023-03-06T13:48:50.075 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:50.073+0000 7fe2dde10700 1 -- 172.21.15.202:0/1598103525 wait complete. 2023-03-06T13:48:50.085 DEBUG:teuthology.orchestra.run.smithi202:> sudo ceph --cluster ceph osd new fa6688d9-73f3-4593-a50e-d96a0fe5f4cf 5 2023-03-06T13:48:50.209 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:50.207+0000 7f44c9a81700 1 Processor -- start 2023-03-06T13:48:50.209 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:50.208+0000 7f44c9a81700 1 -- start start 2023-03-06T13:48:50.210 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-03-06T13:48:50.207+0000 7efc8307c200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-03-06T13:48:50.212 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:50.208+0000 7f44c9a81700 1 --2- >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f44c40c2860 0x7f44c40c2c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:48:50.212 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:50.208+0000 7f44c9a81700 1 --2- >> v2:172.21.15.202:3300/0 conn(0x7f44c40bd220 0x7f44c414f750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:48:50.212 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:50.208+0000 7f44c9a81700 1 -- --> v1:172.21.15.202:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44c4146310 con 0x7f44c414fc90 2023-03-06T13:48:50.213 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:50.208+0000 7f44c9a81700 1 -- --> v2:172.21.15.202:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44c41500f0 con 0x7f44c40bd220 2023-03-06T13:48:50.213 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:50.208+0000 7f44c9a81700 1 -- --> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44c406d420 con 0x7f44c40c2860 2023-03-06T13:48:50.213 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:50.208+0000 7f44c2ffd700 1 --2- >> v2:172.21.15.202:3300/0 conn(0x7f44c40bd220 0x7f44c414f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:48:50.213 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:50.208+0000 7f44c37fe700 1 --2- >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f44c40c2860 0x7f44c40c2c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:48:50.213 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:50.208+0000 7f44c2ffd700 1 --2- >> v2:172.21.15.202:3300/0 conn(0x7f44c40bd220 0x7f44c414f750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.202:3300/0 says I am v2:172.21.15.202:35554/0 (socket says 172.21.15.202:35554) 2023-03-06T13:48:50.213 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:50.208+0000 7f44c3fff700 1 --1- >> v1:172.21.15.202:6789/0 conn(0x7f44c414fc90 0x7f44c406d8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.202:6789/0 says I am v1:172.21.15.202:41088/0 (socket says 172.21.15.202:41088) 2023-03-06T13:48:50.213 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:50.208+0000 7f44c2ffd700 1 -- 172.21.15.202:0/2345410748 learned_addr learned my addr 172.21.15.202:0/2345410748 (peer_addr_for_me v2:172.21.15.202:0/0) 2023-03-06T13:48:50.214 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:50.208+0000 7f44c37fe700 1 --2- >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f44c40c2860 0x7f44c40c2c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.202:3301/0 says I am v2:172.21.15.202:50184/0 (socket says 172.21.15.202:50184) 2023-03-06T13:48:50.214 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:50.209+0000 7f44c2ffd700 1 -- 172.21.15.202:0/2345410748 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f44c40c2860 msgr2=0x7f44c40c2c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T13:48:50.214 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:50.209+0000 7f44c2ffd700 1 --2- 172.21.15.202:0/2345410748 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f44c40c2860 0x7f44c40c2c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:48:50.214 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:50.209+0000 7f44c2ffd700 1 -- 172.21.15.202:0/2345410748 >> v1:172.21.15.202:6789/0 conn(0x7f44c414fc90 legacy=0x7f44c406d8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:48:50.214 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:50.209+0000 7f44c27fc700 1 -- 172.21.15.202:0/2345410748 <== mon.1 v1:172.21.15.202:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2934852301 0 0) 0x7f44bc001490 con 0x7f44c414fc90 2023-03-06T13:48:50.214 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:50.209+0000 7f44c2ffd700 1 -- 172.21.15.202:0/2345410748 --> v2:172.21.15.202:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44c414cc50 con 0x7f44c40bd220 2023-03-06T13:48:50.214 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:50.209+0000 7f44c37fe700 1 --2- 172.21.15.202:0/2345410748 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f44c40c2860 0x7f44c40c2c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-06T13:48:50.215 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:50.209+0000 7f44c2ffd700 1 --2- 172.21.15.202:0/2345410748 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f44c40bd220 0x7f44c414f750 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f44b80098f0 tx=0x7f44b8009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e40ffb711a4d3dbc server_cookie=0 in_seq=0 out_seq=0 2023-03-06T13:48:50.215 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:50.209+0000 7f44c27fc700 1 -- 172.21.15.202:0/2345410748 <== mon.1 v2:172.21.15.202:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44b8011830 con 0x7f44c40bd220 2023-03-06T13:48:50.215 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:50.209+0000 7f44c27fc700 1 -- 172.21.15.202:0/2345410748 <== mon.1 v2:172.21.15.202:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44b8011990 con 0x7f44c40bd220 2023-03-06T13:48:50.215 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:50.209+0000 7f44c27fc700 1 -- 172.21.15.202:0/2345410748 <== mon.1 v2:172.21.15.202:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44b8011d20 con 0x7f44c40bd220 2023-03-06T13:48:50.215 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:50.210+0000 7f44c9a81700 1 -- 172.21.15.202:0/2345410748 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f44c40bd220 msgr2=0x7f44c414f750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:48:50.215 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:50.210+0000 7f44c9a81700 1 --2- 172.21.15.202:0/2345410748 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f44c40bd220 0x7f44c414f750 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f44b80098f0 tx=0x7f44b8009c00 comp rx=0 tx=0).stop 2023-03-06T13:48:50.216 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:50.210+0000 7f44c9a81700 1 -- 172.21.15.202:0/2345410748 shutdown_connections 2023-03-06T13:48:50.216 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:50.210+0000 7f44c9a81700 1 --2- 172.21.15.202:0/2345410748 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f44c40c2860 0x7f44c40c2c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:48:50.216 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:50.210+0000 7f44c9a81700 1 --2- 172.21.15.202:0/2345410748 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f44c40bd220 0x7f44c414f750 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:48:50.216 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:50.210+0000 7f44c9a81700 1 -- 172.21.15.202:0/2345410748 >> 172.21.15.202:0/2345410748 conn(0x7f44c406c0d0 msgr2=0x7f44c40c2150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T13:48:50.216 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:50.210+0000 7f44c9a81700 1 -- 172.21.15.202:0/2345410748 shutdown_connections 2023-03-06T13:48:50.216 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:50.210+0000 7f44c9a81700 1 -- 172.21.15.202:0/2345410748 wait complete. 2023-03-06T13:48:50.218 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:50.211+0000 7f44c9a81700 1 Processor -- start 2023-03-06T13:48:50.219 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:50.212+0000 7f44c9a81700 1 -- start start 2023-03-06T13:48:50.219 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:50.212+0000 7f44c9a81700 1 --2- >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f44c40bd220 0x7f44c41e35c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:48:50.219 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:50.212+0000 7f44c9a81700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f44c40c2860 0x7f44c414b540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:48:50.220 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:50.212+0000 7f44c9a81700 1 --2- >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f44c414fc90 0x7f44c41dfc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:48:50.220 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:50.212+0000 7f44c9a81700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44c41497e0 con 0x7f44c40c2860 2023-03-06T13:48:50.220 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:50.212+0000 7f44c9a81700 1 -- --> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44c41e3b00 con 0x7f44c40bd220 2023-03-06T13:48:50.221 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:50.212+0000 7f44c9a81700 1 -- --> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44c414ba80 con 0x7f44c414fc90 2023-03-06T13:48:50.221 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:50.212+0000 7f44c3fff700 1 --2- >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f44c414fc90 0x7f44c41dfc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:48:50.221 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:50.212+0000 7f44c37fe700 1 --2- >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f44c40bd220 0x7f44c41e35c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:48:50.221 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:50.212+0000 7f44c3fff700 1 --2- >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f44c414fc90 0x7f44c41dfc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.202:3301/0 says I am v2:172.21.15.202:50194/0 (socket says 172.21.15.202:50194) 2023-03-06T13:48:50.221 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:50.212+0000 7f44c3fff700 1 -- 172.21.15.202:0/2221667777 learned_addr learned my addr 172.21.15.202:0/2221667777 (peer_addr_for_me v2:172.21.15.202:0/0) 2023-03-06T13:48:50.221 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:50.212+0000 7f44c37fe700 1 --2- >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f44c40bd220 0x7f44c41e35c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.202:3300/0 says I am v2:172.21.15.202:35558/0 (socket says 172.21.15.202:35558) 2023-03-06T13:48:50.221 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:50.213+0000 7f44c2ffd700 1 --2- 172.21.15.202:0/2221667777 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f44c40c2860 0x7f44c414b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:48:50.222 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:50.213+0000 7f44c3fff700 1 -- 172.21.15.202:0/2221667777 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f44c40bd220 msgr2=0x7f44c41e35c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:48:50.222 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:50.213+0000 7f44c3fff700 1 --2- 172.21.15.202:0/2221667777 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f44c40bd220 0x7f44c41e35c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:48:50.222 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:50.213+0000 7f44c3fff700 1 -- 172.21.15.202:0/2221667777 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f44c40c2860 msgr2=0x7f44c414b540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:48:50.222 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:50.213+0000 7f44c3fff700 1 --2- 172.21.15.202:0/2221667777 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f44c40c2860 0x7f44c414b540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:48:50.222 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:50.213+0000 7f44c3fff700 1 -- 172.21.15.202:0/2221667777 --> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44b40094a0 con 0x7f44c414fc90 2023-03-06T13:48:50.222 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:50.213+0000 7f44c37fe700 1 --2- 172.21.15.202:0/2221667777 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f44c40bd220 0x7f44c41e35c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-06T13:48:50.223 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:50.213+0000 7f44c3fff700 1 --2- 172.21.15.202:0/2221667777 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f44c414fc90 0x7f44c41dfc70 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f44bc00cb90 tx=0x7f44bc00cea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T13:48:50.223 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:50.213+0000 7f44abfff700 1 -- 172.21.15.202:0/2221667777 <== mon.2 v2:172.21.15.202:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44bc00aa80 con 0x7f44c414fc90 2023-03-06T13:48:50.223 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:50.213+0000 7f44abfff700 1 -- 172.21.15.202:0/2221667777 <== mon.2 v2:172.21.15.202:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44bc00abe0 con 0x7f44c414fc90 2023-03-06T13:48:50.223 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:50.213+0000 7f44c9a81700 1 -- 172.21.15.202:0/2221667777 --> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44b8009550 con 0x7f44c414fc90 2023-03-06T13:48:50.223 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:50.213+0000 7f44abfff700 1 -- 172.21.15.202:0/2221667777 <== mon.2 v2:172.21.15.202:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44bc0070d0 con 0x7f44c414fc90 2023-03-06T13:48:50.223 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:50.213+0000 7f44c9a81700 1 -- 172.21.15.202:0/2221667777 --> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44c40bda50 con 0x7f44c414fc90 2023-03-06T13:48:50.223 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:50.213+0000 7f44abfff700 1 -- 172.21.15.202:0/2221667777 <== mon.2 v2:172.21.15.202:3301/0 4 ==== mgrmap(e 1) v1 ==== 656+0+0 (secure 0 0 0) 0x7f44bc010070 con 0x7f44c414fc90 2023-03-06T13:48:50.223 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:50.213+0000 7f44abfff700 1 -- 172.21.15.202:0/2221667777 <== mon.2 v2:172.21.15.202:3301/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7f44bc01b8e0 con 0x7f44c414fc90 2023-03-06T13:48:50.224 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:50.214+0000 7f44c9a81700 1 -- 172.21.15.202:0/2221667777 --> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44c40bdd30 con 0x7f44c414fc90 2023-03-06T13:48:50.224 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:50.216+0000 7f44abfff700 1 -- 172.21.15.202:0/2221667777 <== mon.2 v2:172.21.15.202:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7f44bc018070 con 0x7f44c414fc90 2023-03-06T13:48:50.300 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:50.299+0000 7f44c9a81700 1 -- 172.21.15.202:0/2221667777 --> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] -- mon_command({"prefix": "osd new", "uuid": "fa6688d9-73f3-4593-a50e-d96a0fe5f4cf", "id": 5} v 0) v1 -- 0x7f44c40a7910 con 0x7f44c414fc90 2023-03-06T13:48:50.304 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:50.303+0000 7f44abfff700 1 -- 172.21.15.202:0/2221667777 <== mon.2 v2:172.21.15.202:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "fa6688d9-73f3-4593-a50e-d96a0fe5f4cf", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f44c40a7910 con 0x7f44c414fc90 2023-03-06T13:48:50.305 INFO:teuthology.orchestra.run.smithi202.stdout:5 2023-03-06T13:48:50.306 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:50.304+0000 7f44c9a81700 1 -- 172.21.15.202:0/2221667777 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f44c414fc90 msgr2=0x7f44c41dfc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:48:50.306 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:50.304+0000 7f44c9a81700 1 --2- 172.21.15.202:0/2221667777 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f44c414fc90 0x7f44c41dfc70 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f44bc00cb90 tx=0x7f44bc00cea0 comp rx=0 tx=0).stop 2023-03-06T13:48:50.306 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:50.304+0000 7f44c9a81700 1 -- 172.21.15.202:0/2221667777 shutdown_connections 2023-03-06T13:48:50.306 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:50.304+0000 7f44c9a81700 1 --2- 172.21.15.202:0/2221667777 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f44c414fc90 0x7f44c41dfc70 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:48:50.306 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:50.304+0000 7f44c9a81700 1 --2- 172.21.15.202:0/2221667777 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f44c40bd220 0x7f44c41e35c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:48:50.306 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:50.304+0000 7f44c9a81700 1 --2- 172.21.15.202:0/2221667777 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f44c40c2860 0x7f44c414b540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:48:50.307 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:50.304+0000 7f44c9a81700 1 -- 172.21.15.202:0/2221667777 >> 172.21.15.202:0/2221667777 conn(0x7f44c406c0d0 msgr2=0x7f44c414e1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T13:48:50.307 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:50.304+0000 7f44c9a81700 1 -- 172.21.15.202:0/2221667777 shutdown_connections 2023-03-06T13:48:50.307 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:50.304+0000 7f44c9a81700 1 -- 172.21.15.202:0/2221667777 wait complete. 2023-03-06T13:48:50.314 INFO:tasks.ceph.mgr.x.smithi202.stderr:2023-03-06T13:48:50.313+0000 7f1742eb7200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-03-06T13:48:50.317 DEBUG:teuthology.orchestra.run.smithi202:> sudo ceph --cluster ceph osd new 7bfc6dc0-2388-4498-9cd7-766e3606f6a2 6 2023-03-06T13:48:50.438 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:50.436+0000 7fb6e1ace700 1 Processor -- start 2023-03-06T13:48:50.439 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:50.437+0000 7fb6e1ace700 1 -- start start 2023-03-06T13:48:50.440 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:50.437+0000 7fb6e1ace700 1 --2- >> v2:172.21.15.202:3300/0 conn(0x7fb6dc0c2860 0x7fb6dc0c2c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:48:50.441 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:50.437+0000 7fb6e1ace700 1 --2- >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fb6dc0bd220 0x7fb6dc14f750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:48:50.441 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:50.437+0000 7fb6e1ace700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fb6dc14fc90 0x7fb6dc06d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:48:50.441 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:50.437+0000 7fb6e1ace700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6dc146310 con 0x7fb6dc14fc90 2023-03-06T13:48:50.441 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:50.437+0000 7fb6e1ace700 1 -- --> v2:172.21.15.202:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6dc1500f0 con 0x7fb6dc0c2860 2023-03-06T13:48:50.441 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:50.437+0000 7fb6e1ace700 1 -- --> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6dc06d420 con 0x7fb6dc0bd220 2023-03-06T13:48:50.441 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:50.437+0000 7fb6db7fe700 1 --2- >> v2:172.21.15.202:3300/0 conn(0x7fb6dc0c2860 0x7fb6dc0c2c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:48:50.442 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:50.437+0000 7fb6d2ffd700 1 --2- >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fb6dc0bd220 0x7fb6dc14f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:48:50.442 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:50.437+0000 7fb6db7fe700 1 --2- >> v2:172.21.15.202:3300/0 conn(0x7fb6dc0c2860 0x7fb6dc0c2c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.202:3300/0 says I am v2:172.21.15.202:35564/0 (socket says 172.21.15.202:35564) 2023-03-06T13:48:50.442 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:50.437+0000 7fb6d2ffd700 1 --2- >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fb6dc0bd220 0x7fb6dc14f750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.202:3301/0 says I am v2:172.21.15.202:50196/0 (socket says 172.21.15.202:50196) 2023-03-06T13:48:50.442 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:50.437+0000 7fb6db7fe700 1 -- 172.21.15.202:0/484912092 learned_addr learned my addr 172.21.15.202:0/484912092 (peer_addr_for_me v2:172.21.15.202:0/0) 2023-03-06T13:48:50.442 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:50.438+0000 7fb6dbfff700 1 --2- 172.21.15.202:0/484912092 >> v2:172.21.15.86:3300/0 conn(0x7fb6dc14fc90 0x7fb6dc06d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:48:50.442 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:50.438+0000 7fb6d2ffd700 1 -- 172.21.15.202:0/484912092 >> v2:172.21.15.202:3300/0 conn(0x7fb6dc0c2860 msgr2=0x7fb6dc0c2c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T13:48:50.443 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:50.438+0000 7fb6d2ffd700 1 --2- 172.21.15.202:0/484912092 >> v2:172.21.15.202:3300/0 conn(0x7fb6dc0c2860 0x7fb6dc0c2c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:48:50.443 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:50.438+0000 7fb6d2ffd700 1 -- 172.21.15.202:0/484912092 >> v2:172.21.15.86:3300/0 conn(0x7fb6dc14fc90 msgr2=0x7fb6dc06d8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T13:48:50.443 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:50.438+0000 7fb6d2ffd700 1 --2- 172.21.15.202:0/484912092 >> v2:172.21.15.86:3300/0 conn(0x7fb6dc14fc90 0x7fb6dc06d8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:48:50.443 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:50.438+0000 7fb6d2ffd700 1 -- 172.21.15.202:0/484912092 --> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6dc14cc50 con 0x7fb6dc0bd220 2023-03-06T13:48:50.443 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:50.438+0000 7fb6db7fe700 1 --2- 172.21.15.202:0/484912092 >> v2:172.21.15.202:3300/0 conn(0x7fb6dc0c2860 0x7fb6dc0c2c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-06T13:48:50.444 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:50.438+0000 7fb6dbfff700 1 --2- 172.21.15.202:0/484912092 >> v2:172.21.15.86:3300/0 conn(0x7fb6dc14fc90 0x7fb6dc06d8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-06T13:48:50.444 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:50.438+0000 7fb6d2ffd700 1 --2- 172.21.15.202:0/484912092 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fb6dc0bd220 0x7fb6dc14f750 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fb6dc0676e0 tx=0x7fb6c4009b20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e6e8d88b6621b9d1 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T13:48:50.444 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:50.438+0000 7fb6daffd700 1 -- 172.21.15.202:0/484912092 <== mon.2 v2:172.21.15.202:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6c4011830 con 0x7fb6dc0bd220 2023-03-06T13:48:50.444 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:50.438+0000 7fb6daffd700 1 -- 172.21.15.202:0/484912092 <== mon.2 v2:172.21.15.202:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6c4011990 con 0x7fb6dc0bd220 2023-03-06T13:48:50.444 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:50.438+0000 7fb6daffd700 1 -- 172.21.15.202:0/484912092 <== mon.2 v2:172.21.15.202:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6c4011d20 con 0x7fb6dc0bd220 2023-03-06T13:48:50.444 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:50.439+0000 7fb6e1ace700 1 -- 172.21.15.202:0/484912092 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fb6dc0bd220 msgr2=0x7fb6dc14f750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:48:50.444 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:50.439+0000 7fb6e1ace700 1 --2- 172.21.15.202:0/484912092 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fb6dc0bd220 0x7fb6dc14f750 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fb6dc0676e0 tx=0x7fb6c4009b20 comp rx=0 tx=0).stop 2023-03-06T13:48:50.444 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:50.439+0000 7fb6e1ace700 1 -- 172.21.15.202:0/484912092 shutdown_connections 2023-03-06T13:48:50.445 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:50.439+0000 7fb6e1ace700 1 --2- 172.21.15.202:0/484912092 >> v2:172.21.15.202:3300/0 conn(0x7fb6dc0c2860 0x7fb6dc0c2c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:48:50.445 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:50.439+0000 7fb6e1ace700 1 --2- 172.21.15.202:0/484912092 >> v2:172.21.15.86:3300/0 conn(0x7fb6dc14fc90 0x7fb6dc06d8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:48:50.445 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:50.439+0000 7fb6e1ace700 1 --2- 172.21.15.202:0/484912092 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fb6dc0bd220 0x7fb6dc14f750 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:48:50.445 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:50.439+0000 7fb6e1ace700 1 -- 172.21.15.202:0/484912092 >> 172.21.15.202:0/484912092 conn(0x7fb6dc06c0d0 msgr2=0x7fb6dc0c2150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T13:48:50.445 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:50.439+0000 7fb6e1ace700 1 -- 172.21.15.202:0/484912092 shutdown_connections 2023-03-06T13:48:50.445 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:50.439+0000 7fb6e1ace700 1 -- 172.21.15.202:0/484912092 wait complete. 2023-03-06T13:48:50.447 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:50.440+0000 7fb6e1ace700 1 Processor -- start 2023-03-06T13:48:50.447 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:50.440+0000 7fb6e1ace700 1 -- start start 2023-03-06T13:48:50.447 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:50.441+0000 7fb6e1ace700 1 --2- >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fb6dc0bd220 0x7fb6dc1e2a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:48:50.448 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:50.441+0000 7fb6e1ace700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb6dc0c2860 0x7fb6dc13eee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:48:50.448 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:50.441+0000 7fb6e1ace700 1 --2- >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7fb6dc14fc90 0x7fb6dc142800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:48:50.448 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:50.441+0000 7fb6e1ace700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6dc1451c0 con 0x7fb6dc0c2860 2023-03-06T13:48:50.448 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:50.441+0000 7fb6e1ace700 1 -- --> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6dc13fc40 con 0x7fb6dc14fc90 2023-03-06T13:48:50.448 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:50.441+0000 7fb6e1ace700 1 -- --> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6dc142160 con 0x7fb6dc0bd220 2023-03-06T13:48:50.448 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:50.441+0000 7fb6dbfff700 1 --2- >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7fb6dc14fc90 0x7fb6dc142800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:48:50.448 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:50.441+0000 7fb6db7fe700 1 --2- >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fb6dc0bd220 0x7fb6dc1e2a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:48:50.449 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:50.441+0000 7fb6dbfff700 1 --2- >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7fb6dc14fc90 0x7fb6dc142800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.202:3300/0 says I am v2:172.21.15.202:35574/0 (socket says 172.21.15.202:35574) 2023-03-06T13:48:50.449 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:50.441+0000 7fb6dbfff700 1 -- 172.21.15.202:0/1527891011 learned_addr learned my addr 172.21.15.202:0/1527891011 (peer_addr_for_me v2:172.21.15.202:0/0) 2023-03-06T13:48:50.449 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:50.441+0000 7fb6d2ffd700 1 --2- 172.21.15.202:0/1527891011 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb6dc0c2860 0x7fb6dc13eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:48:50.449 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:50.441+0000 7fb6dbfff700 1 -- 172.21.15.202:0/1527891011 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fb6dc0bd220 msgr2=0x7fb6dc1e2a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:48:50.449 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:50.441+0000 7fb6dbfff700 1 --2- 172.21.15.202:0/1527891011 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fb6dc0bd220 0x7fb6dc1e2a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:48:50.449 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:50.442+0000 7fb6dbfff700 1 -- 172.21.15.202:0/1527891011 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb6dc0c2860 msgr2=0x7fb6dc13eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:48:50.449 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:50.442+0000 7fb6dbfff700 1 --2- 172.21.15.202:0/1527891011 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb6dc0c2860 0x7fb6dc13eee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:48:50.450 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:50.442+0000 7fb6dbfff700 1 -- 172.21.15.202:0/1527891011 --> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6cc009550 con 0x7fb6dc14fc90 2023-03-06T13:48:50.450 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:50.442+0000 7fb6dbfff700 1 --2- 172.21.15.202:0/1527891011 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7fb6dc14fc90 0x7fb6dc142800 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fb6d4007ef0 tx=0x7fb6d400d3b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T13:48:50.450 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:50.442+0000 7fb6d8ff9700 1 -- 172.21.15.202:0/1527891011 <== mon.1 v2:172.21.15.202:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6d400dd70 con 0x7fb6dc14fc90 2023-03-06T13:48:50.450 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:50.442+0000 7fb6d8ff9700 1 -- 172.21.15.202:0/1527891011 <== mon.1 v2:172.21.15.202:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6d400f040 con 0x7fb6dc14fc90 2023-03-06T13:48:50.450 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:50.442+0000 7fb6e1ace700 1 -- 172.21.15.202:0/1527891011 --> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6c40094a0 con 0x7fb6dc14fc90 2023-03-06T13:48:50.450 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:50.442+0000 7fb6d8ff9700 1 -- 172.21.15.202:0/1527891011 <== mon.1 v2:172.21.15.202:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6d4003c60 con 0x7fb6dc14fc90 2023-03-06T13:48:50.450 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:50.442+0000 7fb6e1ace700 1 -- 172.21.15.202:0/1527891011 --> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6dc0bda50 con 0x7fb6dc14fc90 2023-03-06T13:48:50.450 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:50.442+0000 7fb6d8ff9700 1 -- 172.21.15.202:0/1527891011 <== mon.1 v2:172.21.15.202:3300/0 4 ==== mgrmap(e 1) v1 ==== 656+0+0 (secure 0 0 0) 0x7fb6d401c030 con 0x7fb6dc14fc90 2023-03-06T13:48:50.451 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:50.442+0000 7fb6d8ff9700 1 -- 172.21.15.202:0/1527891011 <== mon.1 v2:172.21.15.202:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7fb6d4004760 con 0x7fb6dc14fc90 2023-03-06T13:48:50.451 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:50.443+0000 7fb6e1ace700 1 -- 172.21.15.202:0/1527891011 --> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6dc0bdd30 con 0x7fb6dc14fc90 2023-03-06T13:48:50.451 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:50.447+0000 7fb6d8ff9700 1 -- 172.21.15.202:0/1527891011 <== mon.1 v2:172.21.15.202:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7fb6d401a070 con 0x7fb6dc14fc90 2023-03-06T13:48:50.530 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:50.528+0000 7fb6e1ace700 1 -- 172.21.15.202:0/1527891011 --> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] -- mon_command({"prefix": "osd new", "uuid": "7bfc6dc0-2388-4498-9cd7-766e3606f6a2", "id": 6} v 0) v1 -- 0x7fb6dc04e750 con 0x7fb6dc14fc90 2023-03-06T13:48:50.536 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:50.535+0000 7fb6d8ff9700 1 -- 172.21.15.202:0/1527891011 <== mon.1 v2:172.21.15.202:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "7bfc6dc0-2388-4498-9cd7-766e3606f6a2", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7fb6d4003dc0 con 0x7fb6dc14fc90 2023-03-06T13:48:50.536 INFO:teuthology.orchestra.run.smithi202.stdout:6 2023-03-06T13:48:50.537 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:50.536+0000 7fb6e1ace700 1 -- 172.21.15.202:0/1527891011 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7fb6dc14fc90 msgr2=0x7fb6dc142800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:48:50.538 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:50.536+0000 7fb6e1ace700 1 --2- 172.21.15.202:0/1527891011 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7fb6dc14fc90 0x7fb6dc142800 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fb6d4007ef0 tx=0x7fb6d400d3b0 comp rx=0 tx=0).stop 2023-03-06T13:48:50.538 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:50.536+0000 7fb6e1ace700 1 -- 172.21.15.202:0/1527891011 shutdown_connections 2023-03-06T13:48:50.538 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:50.536+0000 7fb6e1ace700 1 --2- 172.21.15.202:0/1527891011 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7fb6dc14fc90 0x7fb6dc142800 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:48:50.538 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:50.536+0000 7fb6e1ace700 1 --2- 172.21.15.202:0/1527891011 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fb6dc0bd220 0x7fb6dc1e2a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:48:50.538 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:50.536+0000 7fb6e1ace700 1 --2- 172.21.15.202:0/1527891011 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb6dc0c2860 0x7fb6dc13eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:48:50.538 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:50.536+0000 7fb6e1ace700 1 -- 172.21.15.202:0/1527891011 >> 172.21.15.202:0/1527891011 conn(0x7fb6dc06c0d0 msgr2=0x7fb6dc06abc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T13:48:50.538 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:50.536+0000 7fb6e1ace700 1 -- 172.21.15.202:0/1527891011 shutdown_connections 2023-03-06T13:48:50.539 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:50.536+0000 7fb6e1ace700 1 -- 172.21.15.202:0/1527891011 wait complete. 2023-03-06T13:48:50.550 DEBUG:teuthology.orchestra.run.smithi202:> sudo ceph --cluster ceph osd new c475f863-96fd-48e3-8033-7d1c3b1d503f 7 2023-03-06T13:48:50.673 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:50.671+0000 7fa4a0e05700 1 Processor -- start 2023-03-06T13:48:50.673 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:50.671+0000 7fa4a0e05700 1 -- start start 2023-03-06T13:48:50.675 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:50.672+0000 7fa4a0e05700 1 --2- >> v2:172.21.15.202:3300/0 conn(0x7fa49c0bd220 0x7fa49c0c2c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:48:50.675 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:50.672+0000 7fa4a0e05700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa49c146310 con 0x7fa49c0c2860 2023-03-06T13:48:50.675 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:50.672+0000 7fa4a0e05700 1 -- --> v1:172.21.15.202:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa49c06d420 con 0x7fa49c14fe60 2023-03-06T13:48:50.675 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:50.672+0000 7fa4a0e05700 1 -- --> v2:172.21.15.202:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa49c14cc50 con 0x7fa49c0bd220 2023-03-06T13:48:50.675 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:50.672+0000 7fa49ad9d700 1 --2- >> v2:172.21.15.202:3300/0 conn(0x7fa49c0bd220 0x7fa49c0c2c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:48:50.676 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:50.672+0000 7fa499d9b700 1 --1- >> v1:172.21.15.202:6789/0 conn(0x7fa49c14fe60 0x7fa49c154760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.202:6789/0 says I am v1:172.21.15.202:41108/0 (socket says 172.21.15.202:41108) 2023-03-06T13:48:50.676 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:50.672+0000 7fa499d9b700 1 -- 172.21.15.202:0/56107149 learned_addr learned my addr 172.21.15.202:0/56107149 (peer_addr_for_me v1:172.21.15.202:0/0) 2023-03-06T13:48:50.676 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:50.672+0000 7fa49ad9d700 1 -- 172.21.15.202:0/56107149 >> v1:172.21.15.202:6789/0 conn(0x7fa49c14fe60 legacy=0x7fa49c154760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:48:50.676 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:50.673+0000 7fa49ad9d700 1 -- 172.21.15.202:0/56107149 >> v1:172.21.15.86:6789/0 conn(0x7fa49c0c2860 legacy=0x7fa49c14f750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:48:50.676 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:50.673+0000 7fa49959a700 1 -- 172.21.15.202:0/56107149 <== mon.1 v1:172.21.15.202:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3716069081 0 0) 0x7fa49c06d420 con 0x7fa49c14fe60 2023-03-06T13:48:50.676 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:50.673+0000 7fa49ad9d700 1 -- 172.21.15.202:0/56107149 --> v2:172.21.15.202:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa49c0bd770 con 0x7fa49c0bd220 2023-03-06T13:48:50.676 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:50.673+0000 7fa49ad9d700 1 --2- 172.21.15.202:0/56107149 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7fa49c0bd220 0x7fa49c0c2c30 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fa494009d90 tx=0x7fa49400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=91c99fb1d102a08a server_cookie=0 in_seq=0 out_seq=0 2023-03-06T13:48:50.676 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:50.673+0000 7fa49959a700 1 -- 172.21.15.202:0/56107149 <== mon.1 v2:172.21.15.202:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa49400e070 con 0x7fa49c0bd220 2023-03-06T13:48:50.677 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:50.673+0000 7fa49959a700 1 -- 172.21.15.202:0/56107149 <== mon.1 v2:172.21.15.202:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa49400bbd0 con 0x7fa49c0bd220 2023-03-06T13:48:50.677 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:50.673+0000 7fa49959a700 1 -- 172.21.15.202:0/56107149 <== mon.1 v2:172.21.15.202:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa494012430 con 0x7fa49c0bd220 2023-03-06T13:48:50.677 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:50.673+0000 7fa4a0e05700 1 -- 172.21.15.202:0/56107149 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7fa49c0bd220 msgr2=0x7fa49c0c2c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:48:50.677 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:50.673+0000 7fa4a0e05700 1 --2- 172.21.15.202:0/56107149 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7fa49c0bd220 0x7fa49c0c2c30 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fa494009d90 tx=0x7fa49400b330 comp rx=0 tx=0).stop 2023-03-06T13:48:50.677 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:50.674+0000 7fa4a0e05700 1 -- 172.21.15.202:0/56107149 shutdown_connections 2023-03-06T13:48:50.677 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:50.674+0000 7fa4a0e05700 1 --2- 172.21.15.202:0/56107149 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7fa49c0bd220 0x7fa49c0c2c30 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:48:50.677 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:50.674+0000 7fa4a0e05700 1 -- 172.21.15.202:0/56107149 >> 172.21.15.202:0/56107149 conn(0x7fa49c06c0d0 msgr2=0x7fa49c0c2150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T13:48:50.678 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:50.674+0000 7fa4a0e05700 1 -- 172.21.15.202:0/56107149 shutdown_connections 2023-03-06T13:48:50.678 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:50.674+0000 7fa4a0e05700 1 -- 172.21.15.202:0/56107149 wait complete. 2023-03-06T13:48:50.680 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:50.675+0000 7fa4a0e05700 1 Processor -- start 2023-03-06T13:48:50.680 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:50.675+0000 7fa4a0e05700 1 -- start start 2023-03-06T13:48:50.680 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:50.676+0000 7fa4a0e05700 1 --2- >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fa49c0bd220 0x7fa49c06a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:48:50.680 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:50.676+0000 7fa4a0e05700 1 --2- >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7fa49c0c2860 0x7fa49c145390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:48:50.680 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:50.676+0000 7fa4a0e05700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa49c14fe60 0x7fa49c1458d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:48:50.681 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:50.676+0000 7fa4a0e05700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa49c0a67c0 con 0x7fa49c14fe60 2023-03-06T13:48:50.681 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:50.676+0000 7fa4a0e05700 1 -- --> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa49c1d79f0 con 0x7fa49c0c2860 2023-03-06T13:48:50.681 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:50.676+0000 7fa4a0e05700 1 -- --> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa49c06aae0 con 0x7fa49c0bd220 2023-03-06T13:48:50.681 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:50.676+0000 7fa49a59c700 1 --2- >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fa49c0bd220 0x7fa49c06a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:48:50.681 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:50.676+0000 7fa499d9b700 1 --2- >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7fa49c0c2860 0x7fa49c145390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:48:50.681 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:50.676+0000 7fa49a59c700 1 --2- >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fa49c0bd220 0x7fa49c06a5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.202:3301/0 says I am v2:172.21.15.202:50212/0 (socket says 172.21.15.202:50212) 2023-03-06T13:48:50.681 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:50.676+0000 7fa49a59c700 1 -- 172.21.15.202:0/1759036562 learned_addr learned my addr 172.21.15.202:0/1759036562 (peer_addr_for_me v2:172.21.15.202:0/0) 2023-03-06T13:48:50.682 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:50.676+0000 7fa49ad9d700 1 --2- 172.21.15.202:0/1759036562 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa49c14fe60 0x7fa49c1458d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:48:50.682 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:50.677+0000 7fa499d9b700 1 -- 172.21.15.202:0/1759036562 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fa49c0bd220 msgr2=0x7fa49c06a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:48:50.682 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:50.677+0000 7fa499d9b700 1 --2- 172.21.15.202:0/1759036562 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fa49c0bd220 0x7fa49c06a5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:48:50.682 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:50.677+0000 7fa499d9b700 1 -- 172.21.15.202:0/1759036562 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa49c14fe60 msgr2=0x7fa49c1458d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:48:50.682 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:50.677+0000 7fa499d9b700 1 --2- 172.21.15.202:0/1759036562 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa49c14fe60 0x7fa49c1458d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:48:50.682 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:50.677+0000 7fa499d9b700 1 -- 172.21.15.202:0/1759036562 --> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa494009a70 con 0x7fa49c0c2860 2023-03-06T13:48:50.682 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:50.677+0000 7fa49a59c700 1 --2- 172.21.15.202:0/1759036562 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fa49c0bd220 0x7fa49c06a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-06T13:48:50.682 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:50.677+0000 7fa49ad9d700 1 --2- 172.21.15.202:0/1759036562 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa49c14fe60 0x7fa49c1458d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-06T13:48:50.683 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:50.677+0000 7fa499d9b700 1 --2- 172.21.15.202:0/1759036562 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7fa49c0c2860 0x7fa49c145390 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fa49000c420 tx=0x7fa49000c730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T13:48:50.683 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:50.677+0000 7fa48affd700 1 -- 172.21.15.202:0/1759036562 <== mon.1 v2:172.21.15.202:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa490004c80 con 0x7fa49c0c2860 2023-03-06T13:48:50.683 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:50.677+0000 7fa48affd700 1 -- 172.21.15.202:0/1759036562 <== mon.1 v2:172.21.15.202:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa490004e00 con 0x7fa49c0c2860 2023-03-06T13:48:50.683 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:50.677+0000 7fa48affd700 1 -- 172.21.15.202:0/1759036562 <== mon.1 v2:172.21.15.202:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa490007310 con 0x7fa49c0c2860 2023-03-06T13:48:50.683 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:50.677+0000 7fa4a0e05700 1 -- 172.21.15.202:0/1759036562 --> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa49c0bdd30 con 0x7fa49c0c2860 2023-03-06T13:48:50.683 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:50.677+0000 7fa4a0e05700 1 -- 172.21.15.202:0/1759036562 --> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa49c0bda50 con 0x7fa49c0c2860 2023-03-06T13:48:50.683 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:50.677+0000 7fa48affd700 1 -- 172.21.15.202:0/1759036562 <== mon.1 v2:172.21.15.202:3300/0 4 ==== mgrmap(e 1) v1 ==== 656+0+0 (secure 0 0 0) 0x7fa49001a020 con 0x7fa49c0c2860 2023-03-06T13:48:50.684 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:50.677+0000 7fa48affd700 1 -- 172.21.15.202:0/1759036562 <== mon.1 v2:172.21.15.202:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7fa49000ce30 con 0x7fa49c0c2860 2023-03-06T13:48:50.684 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:50.678+0000 7fa4a0e05700 1 -- 172.21.15.202:0/1759036562 --> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa49c0723b0 con 0x7fa49c0c2860 2023-03-06T13:48:50.684 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:50.680+0000 7fa48affd700 1 -- 172.21.15.202:0/1759036562 <== mon.1 v2:172.21.15.202:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7fa49001d4a0 con 0x7fa49c0c2860 2023-03-06T13:48:50.762 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-03-06T13:48:50.760+0000 7efc8307c200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-03-06T13:48:50.776 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:50.775+0000 7fa4a0e05700 1 -- 172.21.15.202:0/1759036562 --> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] -- mon_command({"prefix": "osd new", "uuid": "c475f863-96fd-48e3-8033-7d1c3b1d503f", "id": 7} v 0) v1 -- 0x7fa49c1e5f60 con 0x7fa49c0c2860 2023-03-06T13:48:50.800 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:50.799+0000 7fa48affd700 1 -- 172.21.15.202:0/1759036562 <== mon.1 v2:172.21.15.202:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c475f863-96fd-48e3-8033-7d1c3b1d503f", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7fa49c1e5f60 con 0x7fa49c0c2860 2023-03-06T13:48:50.801 INFO:teuthology.orchestra.run.smithi202.stdout:7 2023-03-06T13:48:50.802 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:50.800+0000 7fa4a0e05700 1 -- 172.21.15.202:0/1759036562 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7fa49c0c2860 msgr2=0x7fa49c145390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:48:50.802 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:50.801+0000 7fa4a0e05700 1 --2- 172.21.15.202:0/1759036562 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7fa49c0c2860 0x7fa49c145390 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fa49000c420 tx=0x7fa49000c730 comp rx=0 tx=0).stop 2023-03-06T13:48:50.803 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:50.801+0000 7fa4a0e05700 1 -- 172.21.15.202:0/1759036562 shutdown_connections 2023-03-06T13:48:50.803 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:50.801+0000 7fa4a0e05700 1 --2- 172.21.15.202:0/1759036562 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa49c14fe60 0x7fa49c1458d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:48:50.803 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:50.801+0000 7fa4a0e05700 1 --2- 172.21.15.202:0/1759036562 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fa49c0bd220 0x7fa49c06a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:48:50.803 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:50.801+0000 7fa4a0e05700 1 --2- 172.21.15.202:0/1759036562 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7fa49c0c2860 0x7fa49c145390 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:48:50.803 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:50.801+0000 7fa4a0e05700 1 -- 172.21.15.202:0/1759036562 >> 172.21.15.202:0/1759036562 conn(0x7fa49c06c0d0 msgr2=0x7fa49c0c08b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T13:48:50.803 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:50.801+0000 7fa4a0e05700 1 -- 172.21.15.202:0/1759036562 shutdown_connections 2023-03-06T13:48:50.803 INFO:teuthology.orchestra.run.smithi202.stderr:2023-03-06T13:48:50.801+0000 7fa4a0e05700 1 -- 172.21.15.202:0/1759036562 wait complete. 2023-03-06T13:48:50.814 INFO:tasks.ceph.osd.0:Restarting daemon 2023-03-06T13:48:50.815 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-03-06T13:48:50.817 INFO:tasks.ceph.osd.0:Started 2023-03-06T13:48:50.817 INFO:tasks.ceph.osd.1:Restarting daemon 2023-03-06T13:48:50.817 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-03-06T13:48:50.819 INFO:tasks.ceph.osd.1:Started 2023-03-06T13:48:50.820 INFO:tasks.ceph.osd.2:Restarting daemon 2023-03-06T13:48:50.820 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-03-06T13:48:50.822 INFO:tasks.ceph.osd.2:Started 2023-03-06T13:48:50.823 INFO:tasks.ceph.osd.3:Restarting daemon 2023-03-06T13:48:50.823 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-03-06T13:48:50.825 INFO:tasks.ceph.osd.3:Started 2023-03-06T13:48:50.825 INFO:tasks.ceph.osd.4:Restarting daemon 2023-03-06T13:48:50.826 DEBUG:teuthology.orchestra.run.smithi202:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-03-06T13:48:50.827 INFO:tasks.ceph.osd.4:Started 2023-03-06T13:48:50.828 INFO:tasks.ceph.osd.5:Restarting daemon 2023-03-06T13:48:50.828 DEBUG:teuthology.orchestra.run.smithi202:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-03-06T13:48:50.830 INFO:tasks.ceph.osd.5:Started 2023-03-06T13:48:50.830 INFO:tasks.ceph.osd.6:Restarting daemon 2023-03-06T13:48:50.830 DEBUG:teuthology.orchestra.run.smithi202:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-03-06T13:48:50.832 INFO:tasks.ceph.osd.6:Started 2023-03-06T13:48:50.832 INFO:tasks.ceph.osd.7:Restarting daemon 2023-03-06T13:48:50.832 DEBUG:teuthology.orchestra.run.smithi202:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-03-06T13:48:50.834 INFO:tasks.ceph.osd.7:Started 2023-03-06T13:48:50.835 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-03-06T13:48:50.836 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-03-06T13:48:50.834+0000 7efc8307c200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-03-06T13:48:50.924 INFO:tasks.ceph.mgr.x.smithi202.stderr:2023-03-06T13:48:50.920+0000 7f1742eb7200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-03-06T13:48:50.984 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:48:50.982+0000 7fd4335f7700 1 Processor -- start 2023-03-06T13:48:50.985 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:48:50.983+0000 7fd4335f7700 1 -- start start 2023-03-06T13:48:50.987 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:48:50.983+0000 7fd4335f7700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fd42c151230 0x7fd42c0bd770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:48:50.987 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:48:50.983+0000 7fd4335f7700 1 --2- >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fd42c0c0a20 0x7fd42c06cae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:48:50.987 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:48:50.983+0000 7fd4335f7700 1 --2- >> v2:172.21.15.202:3300/0 conn(0x7fd42c06d020 0x7fd42c06a330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:48:50.987 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:48:50.983+0000 7fd4335f7700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd42c0c14e0 con 0x7fd42c151230 2023-03-06T13:48:50.988 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:48:50.983+0000 7fd4335f7700 1 -- --> v2:172.21.15.202:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd42c0bfa60 con 0x7fd42c06d020 2023-03-06T13:48:50.988 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:48:50.983+0000 7fd4335f7700 1 -- --> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd42c0a0d30 con 0x7fd42c0c0a20 2023-03-06T13:48:50.988 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:48:50.984+0000 7fd431393700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fd42c151230 0x7fd42c0bd770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:48:50.988 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:48:50.984+0000 7fd431393700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fd42c151230 0x7fd42c0bd770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:37958/0 (socket says 172.21.15.86:37958) 2023-03-06T13:48:50.988 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:48:50.984+0000 7fd431393700 1 -- 172.21.15.86:0/1855227896 learned_addr learned my addr 172.21.15.86:0/1855227896 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-03-06T13:48:50.988 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:48:50.984+0000 7fd431b94700 1 --2- 172.21.15.86:0/1855227896 >> v2:172.21.15.202:3300/0 conn(0x7fd42c06d020 0x7fd42c06a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:48:50.988 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:48:50.984+0000 7fd430b92700 1 --2- 172.21.15.86:0/1855227896 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fd42c0c0a20 0x7fd42c06cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:48:50.989 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:48:50.984+0000 7fd431393700 1 -- 172.21.15.86:0/1855227896 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fd42c0c0a20 msgr2=0x7fd42c06cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T13:48:50.989 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:48:50.984+0000 7fd431393700 1 --2- 172.21.15.86:0/1855227896 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fd42c0c0a20 0x7fd42c06cae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:48:50.990 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:48:50.984+0000 7fd431393700 1 -- 172.21.15.86:0/1855227896 >> v2:172.21.15.202:3300/0 conn(0x7fd42c06d020 msgr2=0x7fd42c06a330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T13:48:50.990 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:48:50.984+0000 7fd431393700 1 --2- 172.21.15.86:0/1855227896 >> v2:172.21.15.202:3300/0 conn(0x7fd42c06d020 0x7fd42c06a330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:48:50.990 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:48:50.984+0000 7fd431393700 1 -- 172.21.15.86:0/1855227896 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd42c151600 con 0x7fd42c151230 2023-03-06T13:48:50.990 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:48:50.984+0000 7fd431393700 1 --2- 172.21.15.86:0/1855227896 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd42c151230 0x7fd42c0bd770 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fd42c0bbee0 tx=0x7fd428009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b308b53f3546a7b1 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T13:48:50.991 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:48:50.984+0000 7fd423fff700 1 -- 172.21.15.86:0/1855227896 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd428011830 con 0x7fd42c151230 2023-03-06T13:48:50.991 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:48:50.984+0000 7fd423fff700 1 -- 172.21.15.86:0/1855227896 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd428011990 con 0x7fd42c151230 2023-03-06T13:48:50.991 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:48:50.984+0000 7fd423fff700 1 -- 172.21.15.86:0/1855227896 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd428011d20 con 0x7fd42c151230 2023-03-06T13:48:50.991 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:48:50.985+0000 7fd4335f7700 1 -- 172.21.15.86:0/1855227896 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd42c151230 msgr2=0x7fd42c0bd770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:48:50.991 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:48:50.985+0000 7fd4335f7700 1 --2- 172.21.15.86:0/1855227896 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd42c151230 0x7fd42c0bd770 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fd42c0bbee0 tx=0x7fd428009bd0 comp rx=0 tx=0).stop 2023-03-06T13:48:50.991 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:48:50.985+0000 7fd4335f7700 1 -- 172.21.15.86:0/1855227896 shutdown_connections 2023-03-06T13:48:50.991 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:48:50.985+0000 7fd4335f7700 1 --2- 172.21.15.86:0/1855227896 >> v2:172.21.15.202:3300/0 conn(0x7fd42c06d020 0x7fd42c06a330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:48:50.992 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:48:50.985+0000 7fd4335f7700 1 --2- 172.21.15.86:0/1855227896 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd42c151230 0x7fd42c0bd770 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:48:50.992 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:48:50.985+0000 7fd4335f7700 1 --2- 172.21.15.86:0/1855227896 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fd42c0c0a20 0x7fd42c06cae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:48:50.992 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:48:50.985+0000 7fd4335f7700 1 -- 172.21.15.86:0/1855227896 >> 172.21.15.86:0/1855227896 conn(0x7fd42c0c1900 msgr2=0x7fd42c0c1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T13:48:50.992 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:48:50.985+0000 7fd4335f7700 1 -- 172.21.15.86:0/1855227896 shutdown_connections 2023-03-06T13:48:50.992 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:48:50.985+0000 7fd4335f7700 1 -- 172.21.15.86:0/1855227896 wait complete. 2023-03-06T13:48:50.994 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:48:50.986+0000 7fd4335f7700 1 Processor -- start 2023-03-06T13:48:50.994 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:48:50.986+0000 7fd4335f7700 1 -- start start 2023-03-06T13:48:50.995 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:48:50.986+0000 7fd4335f7700 1 --2- >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fd42c06d020 0x7fd42c09de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:48:50.995 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:48:50.987+0000 7fd4335f7700 1 --2- >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7fd42c0c0a20 0x7fd42c0a00b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:48:50.995 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:48:50.987+0000 7fd4335f7700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd42c151230 0x7fd42c0a2350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:48:50.995 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:48:50.987+0000 7fd4335f7700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd42c09f260 con 0x7fd42c151230 2023-03-06T13:48:50.995 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:48:50.987+0000 7fd4335f7700 1 -- --> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd42c149db0 con 0x7fd42c0c0a20 2023-03-06T13:48:50.995 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:48:50.987+0000 7fd4335f7700 1 -- --> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd42c149ad0 con 0x7fd42c06d020 2023-03-06T13:48:50.995 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:48:50.987+0000 7fd431b94700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd42c151230 0x7fd42c0a2350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:48:50.996 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:48:50.987+0000 7fd431b94700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd42c151230 0x7fd42c0a2350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:37968/0 (socket says 172.21.15.86:37968) 2023-03-06T13:48:50.996 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:48:50.987+0000 7fd431b94700 1 -- 172.21.15.86:0/3986538649 learned_addr learned my addr 172.21.15.86:0/3986538649 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-03-06T13:48:50.996 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:48:50.987+0000 7fd430b92700 1 --2- 172.21.15.86:0/3986538649 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7fd42c0c0a20 0x7fd42c0a00b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:48:50.997 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:48:50.987+0000 7fd431393700 1 --2- 172.21.15.86:0/3986538649 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fd42c06d020 0x7fd42c09de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:48:50.997 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:48:50.987+0000 7fd431b94700 1 -- 172.21.15.86:0/3986538649 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fd42c06d020 msgr2=0x7fd42c09de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:48:50.998 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:48:50.987+0000 7fd431b94700 1 --2- 172.21.15.86:0/3986538649 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fd42c06d020 0x7fd42c09de50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:48:50.998 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:48:50.987+0000 7fd431b94700 1 -- 172.21.15.86:0/3986538649 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7fd42c0c0a20 msgr2=0x7fd42c0a00b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:48:50.998 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:48:50.987+0000 7fd431b94700 1 --2- 172.21.15.86:0/3986538649 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7fd42c0c0a20 0x7fd42c0a00b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:48:50.998 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:48:50.987+0000 7fd431b94700 1 -- 172.21.15.86:0/3986538649 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd428009550 con 0x7fd42c151230 2023-03-06T13:48:50.998 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:48:50.987+0000 7fd430b92700 1 --2- 172.21.15.86:0/3986538649 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7fd42c0c0a20 0x7fd42c0a00b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-06T13:48:50.998 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:48:50.987+0000 7fd431b94700 1 --2- 172.21.15.86:0/3986538649 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd42c151230 0x7fd42c0a2350 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fd42400eed0 tx=0x7fd42400b390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T13:48:50.998 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:48:50.987+0000 7fd421ffb700 1 -- 172.21.15.86:0/3986538649 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd424010040 con 0x7fd42c151230 2023-03-06T13:48:50.999 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:48:50.987+0000 7fd421ffb700 1 -- 172.21.15.86:0/3986538649 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd42400bca0 con 0x7fd42c151230 2023-03-06T13:48:50.999 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:48:50.987+0000 7fd421ffb700 1 -- 172.21.15.86:0/3986538649 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd424009ea0 con 0x7fd42c151230 2023-03-06T13:48:50.999 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:48:50.987+0000 7fd4335f7700 1 -- 172.21.15.86:0/3986538649 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd42c0bf780 con 0x7fd42c151230 2023-03-06T13:48:50.999 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:48:50.988+0000 7fd4335f7700 1 -- 172.21.15.86:0/3986538649 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd42c06d570 con 0x7fd42c151230 2023-03-06T13:48:50.999 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:48:50.988+0000 7fd421ffb700 1 -- 172.21.15.86:0/3986538649 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 1) v1 ==== 656+0+0 (secure 0 0 0) 0x7fd424014640 con 0x7fd42c151230 2023-03-06T13:48:50.999 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:48:50.988+0000 7fd421ffb700 1 -- 172.21.15.86:0/3986538649 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7fd42401dbc0 con 0x7fd42c151230 2023-03-06T13:48:50.999 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:48:50.988+0000 7fd4335f7700 1 -- 172.21.15.86:0/3986538649 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd42c0a0f80 con 0x7fd42c151230 2023-03-06T13:48:51.000 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:48:50.991+0000 7fd421ffb700 1 -- 172.21.15.86:0/3986538649 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7fd42403bb00 con 0x7fd42c151230 2023-03-06T13:48:51.000 INFO:tasks.ceph.mgr.x.smithi202.stderr:2023-03-06T13:48:50.995+0000 7f1742eb7200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-03-06T13:48:51.061 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:48:51.059+0000 7fd4335f7700 1 -- 172.21.15.86:0/3986538649 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd42c09f3d0 con 0x7fd42c151230 2023-03-06T13:48:51.062 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:48:51.060+0000 7fd421ffb700 1 -- 172.21.15.86:0/3986538649 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7fd42402a070 con 0x7fd42c151230 2023-03-06T13:48:51.063 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-03-06T13:48:51.063 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":10,"fsid":"2cca6c77-50cb-47d8-a8c7-444575d01327","created":"2023-03-06T13:48:48.337369+0000","modified":"2023-03-06T13:48:50.777249+0000","last_up_change":"0.000000","last_in_change":"2023-03-06T13:48:50.777249+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"2de68e69-e10f-49e1-a15a-8a9bfff504c1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"3e75c061-0de5-4742-a20d-4b5a4adb9b81","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"38d71bce-81c2-4e33-91e1-65efb08f2291","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"d95a2686-21bd-4b66-9ea5-eef65403935b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"98c7e359-0f00-496a-8aaa-5472af355e48","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"fa6688d9-73f3-4593-a50e-d96a0fe5f4cf","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"7bfc6dc0-2388-4498-9cd7-766e3606f6a2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"c475f863-96fd-48e3-8033-7d1c3b1d503f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-03-06T13:48:51.065 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:48:51.061+0000 7fd4335f7700 1 -- 172.21.15.86:0/3986538649 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd42c151230 msgr2=0x7fd42c0a2350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:48:51.065 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:48:51.061+0000 7fd4335f7700 1 --2- 172.21.15.86:0/3986538649 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd42c151230 0x7fd42c0a2350 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fd42400eed0 tx=0x7fd42400b390 comp rx=0 tx=0).stop 2023-03-06T13:48:51.065 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:48:51.061+0000 7fd4335f7700 1 -- 172.21.15.86:0/3986538649 shutdown_connections 2023-03-06T13:48:51.066 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:48:51.061+0000 7fd4335f7700 1 --2- 172.21.15.86:0/3986538649 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd42c151230 0x7fd42c0a2350 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:48:51.066 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:48:51.061+0000 7fd4335f7700 1 --2- 172.21.15.86:0/3986538649 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fd42c06d020 0x7fd42c09de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:48:51.066 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:48:51.061+0000 7fd4335f7700 1 --2- 172.21.15.86:0/3986538649 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7fd42c0c0a20 0x7fd42c0a00b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:48:51.067 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:48:51.061+0000 7fd4335f7700 1 -- 172.21.15.86:0/3986538649 >> 172.21.15.86:0/3986538649 conn(0x7fd42c0c1900 msgr2=0x7fd42c0c1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T13:48:51.067 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:48:51.061+0000 7fd4335f7700 1 -- 172.21.15.86:0/3986538649 shutdown_connections 2023-03-06T13:48:51.067 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:48:51.061+0000 7fd4335f7700 1 -- 172.21.15.86:0/3986538649 wait complete. 2023-03-06T13:48:51.075 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-03-06T13:48:51.075 INFO:tasks.ceph:Waiting for OSDs to come up 2023-03-06T13:48:51.422 INFO:tasks.ceph.osd.1.smithi086.stderr:2023-03-06T13:48:51.420+0000 7f5027152640 -1 Falling back to public interface 2023-03-06T13:48:51.443 INFO:tasks.ceph.osd.7.smithi202.stderr:2023-03-06T13:48:51.441+0000 7f1137742640 -1 Falling back to public interface 2023-03-06T13:48:51.443 INFO:tasks.ceph.osd.6.smithi202.stderr:2023-03-06T13:48:51.442+0000 7f986ebb5640 -1 Falling back to public interface 2023-03-06T13:48:51.455 INFO:tasks.ceph.osd.4.smithi202.stderr:2023-03-06T13:48:51.453+0000 7f2fa6b5d640 -1 Falling back to public interface 2023-03-06T13:48:51.455 INFO:tasks.ceph.osd.2.smithi086.stderr:2023-03-06T13:48:51.453+0000 7f097bd16640 -1 Falling back to public interface 2023-03-06T13:48:51.456 INFO:tasks.ceph.osd.0.smithi086.stderr:2023-03-06T13:48:51.454+0000 7fe6aa6c6640 -1 Falling back to public interface 2023-03-06T13:48:51.460 INFO:tasks.ceph.osd.5.smithi202.stderr:2023-03-06T13:48:51.459+0000 7f5e211bb640 -1 Falling back to public interface 2023-03-06T13:48:51.461 INFO:tasks.ceph.osd.3.smithi086.stderr:2023-03-06T13:48:51.459+0000 7fc437bf7640 -1 Falling back to public interface 2023-03-06T13:48:51.548 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-03-06T13:48:51.546+0000 7efc8307c200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-03-06T13:48:51.624 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-03-06T13:48:51.622+0000 7efc8307c200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-03-06T13:48:51.676 INFO:tasks.ceph.mgr.x.smithi202.stderr:2023-03-06T13:48:51.675+0000 7f1742eb7200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-03-06T13:48:51.755 INFO:tasks.ceph.mgr.x.smithi202.stderr:2023-03-06T13:48:51.754+0000 7f1742eb7200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-03-06T13:48:51.763 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-03-06T13:48:51.761+0000 7efc8307c200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-03-06T13:48:51.880 DEBUG:teuthology.orchestra.run.smithi086:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-03-06T13:48:51.893 INFO:tasks.ceph.mgr.x.smithi202.stderr:2023-03-06T13:48:51.892+0000 7f1742eb7200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-03-06T13:48:51.997 INFO:teuthology.misc.health.smithi086.stderr:2023-03-06T13:48:51.995+0000 7fa6717f9700 1 Processor -- start 2023-03-06T13:48:51.998 INFO:teuthology.misc.health.smithi086.stderr:2023-03-06T13:48:51.995+0000 7fa6717f9700 1 -- start start 2023-03-06T13:48:52.000 INFO:teuthology.misc.health.smithi086.stderr:2023-03-06T13:48:51.996+0000 7fa6717f9700 1 --2- >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fa66c0c1a50 0x7fa66c06c460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:48:52.000 INFO:teuthology.misc.health.smithi086.stderr:2023-03-06T13:48:51.996+0000 7fa6717f9700 1 --2- >> v2:172.21.15.202:3300/0 conn(0x7fa66c1534e0 0x7fa66c14f270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:48:52.000 INFO:teuthology.misc.health.smithi086.stderr:2023-03-06T13:48:51.996+0000 7fa6717f9700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa66c06c9a0 con 0x7fa66c0c4b00 2023-03-06T13:48:52.000 INFO:teuthology.misc.health.smithi086.stderr:2023-03-06T13:48:51.996+0000 7fa6717f9700 1 -- --> v2:172.21.15.202:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa66c0c1e20 con 0x7fa66c1534e0 2023-03-06T13:48:52.000 INFO:teuthology.misc.health.smithi086.stderr:2023-03-06T13:48:51.996+0000 7fa6717f9700 1 -- --> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa66c14f7b0 con 0x7fa66c0c1a50 2023-03-06T13:48:52.001 INFO:teuthology.misc.health.smithi086.stderr:2023-03-06T13:48:51.996+0000 7fa66b7fe700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7fa66c0c4b00 0x7fa66c148ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:48120/0 (socket says 172.21.15.86:48120) 2023-03-06T13:48:52.001 INFO:teuthology.misc.health.smithi086.stderr:2023-03-06T13:48:51.996+0000 7fa66b7fe700 1 -- 172.21.15.86:0/4220143686 learned_addr learned my addr 172.21.15.86:0/4220143686 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-03-06T13:48:52.001 INFO:teuthology.misc.health.smithi086.stderr:2023-03-06T13:48:51.996+0000 7fa66affd700 1 --2- 172.21.15.86:0/4220143686 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fa66c0c1a50 0x7fa66c06c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:48:52.001 INFO:teuthology.misc.health.smithi086.stderr:2023-03-06T13:48:51.996+0000 7fa66a7fc700 1 --2- 172.21.15.86:0/4220143686 >> v2:172.21.15.202:3300/0 conn(0x7fa66c1534e0 0x7fa66c14f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:48:52.001 INFO:teuthology.misc.health.smithi086.stderr:2023-03-06T13:48:51.996+0000 7fa669ffb700 1 -- 172.21.15.86:0/4220143686 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4251369514 0 0) 0x7fa66c06c9a0 con 0x7fa66c0c4b00 2023-03-06T13:48:52.001 INFO:teuthology.misc.health.smithi086.stderr:2023-03-06T13:48:51.996+0000 7fa669ffb700 1 -- 172.21.15.86:0/4220143686 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa6580035b0 con 0x7fa66c0c4b00 2023-03-06T13:48:52.001 INFO:teuthology.misc.health.smithi086.stderr:2023-03-06T13:48:51.996+0000 7fa66a7fc700 1 -- 172.21.15.86:0/4220143686 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fa66c0c1a50 msgr2=0x7fa66c06c460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T13:48:52.002 INFO:teuthology.misc.health.smithi086.stderr:2023-03-06T13:48:51.996+0000 7fa66a7fc700 1 --2- 172.21.15.86:0/4220143686 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fa66c0c1a50 0x7fa66c06c460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:48:52.002 INFO:teuthology.misc.health.smithi086.stderr:2023-03-06T13:48:51.996+0000 7fa66a7fc700 1 -- 172.21.15.86:0/4220143686 >> v1:172.21.15.86:6789/0 conn(0x7fa66c0c4b00 legacy=0x7fa66c148ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:48:52.002 INFO:teuthology.misc.health.smithi086.stderr:2023-03-06T13:48:51.996+0000 7fa66a7fc700 1 -- 172.21.15.86:0/4220143686 --> v2:172.21.15.202:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa66c06cbf0 con 0x7fa66c1534e0 2023-03-06T13:48:52.002 INFO:teuthology.misc.health.smithi086.stderr:2023-03-06T13:48:51.996+0000 7fa66affd700 1 --2- 172.21.15.86:0/4220143686 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fa66c0c1a50 0x7fa66c06c460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-06T13:48:52.002 INFO:teuthology.misc.health.smithi086.stderr:2023-03-06T13:48:51.997+0000 7fa66a7fc700 1 --2- 172.21.15.86:0/4220143686 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7fa66c1534e0 0x7fa66c14f270 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fa654009840 tx=0x7fa654009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=510de52b0a4a992b server_cookie=0 in_seq=0 out_seq=0 2023-03-06T13:48:52.002 INFO:teuthology.misc.health.smithi086.stderr:2023-03-06T13:48:51.997+0000 7fa669ffb700 1 -- 172.21.15.86:0/4220143686 <== mon.1 v2:172.21.15.202:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa654011830 con 0x7fa66c1534e0 2023-03-06T13:48:52.002 INFO:teuthology.misc.health.smithi086.stderr:2023-03-06T13:48:51.997+0000 7fa669ffb700 1 -- 172.21.15.86:0/4220143686 <== mon.1 v2:172.21.15.202:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa654011990 con 0x7fa66c1534e0 2023-03-06T13:48:52.003 INFO:teuthology.misc.health.smithi086.stderr:2023-03-06T13:48:51.997+0000 7fa669ffb700 1 -- 172.21.15.86:0/4220143686 <== mon.1 v2:172.21.15.202:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa654011d20 con 0x7fa66c1534e0 2023-03-06T13:48:52.003 INFO:teuthology.misc.health.smithi086.stderr:2023-03-06T13:48:51.997+0000 7fa6717f9700 1 -- 172.21.15.86:0/4220143686 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7fa66c1534e0 msgr2=0x7fa66c14f270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:48:52.003 INFO:teuthology.misc.health.smithi086.stderr:2023-03-06T13:48:51.997+0000 7fa6717f9700 1 --2- 172.21.15.86:0/4220143686 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7fa66c1534e0 0x7fa66c14f270 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fa654009840 tx=0x7fa654009b50 comp rx=0 tx=0).stop 2023-03-06T13:48:52.003 INFO:teuthology.misc.health.smithi086.stderr:2023-03-06T13:48:51.997+0000 7fa6717f9700 1 -- 172.21.15.86:0/4220143686 shutdown_connections 2023-03-06T13:48:52.003 INFO:teuthology.misc.health.smithi086.stderr:2023-03-06T13:48:51.997+0000 7fa6717f9700 1 --2- 172.21.15.86:0/4220143686 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fa66c0c1a50 0x7fa66c06c460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:48:52.003 INFO:teuthology.misc.health.smithi086.stderr:2023-03-06T13:48:51.997+0000 7fa6717f9700 1 --2- 172.21.15.86:0/4220143686 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7fa66c1534e0 0x7fa66c14f270 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:48:52.003 INFO:teuthology.misc.health.smithi086.stderr:2023-03-06T13:48:51.997+0000 7fa6717f9700 1 -- 172.21.15.86:0/4220143686 >> 172.21.15.86:0/4220143686 conn(0x7fa66c0c5560 msgr2=0x7fa66c0c5960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T13:48:52.004 INFO:teuthology.misc.health.smithi086.stderr:2023-03-06T13:48:51.997+0000 7fa6717f9700 1 -- 172.21.15.86:0/4220143686 shutdown_connections 2023-03-06T13:48:52.004 INFO:teuthology.misc.health.smithi086.stderr:2023-03-06T13:48:51.997+0000 7fa6717f9700 1 -- 172.21.15.86:0/4220143686 wait complete. 2023-03-06T13:48:52.006 INFO:teuthology.misc.health.smithi086.stderr:2023-03-06T13:48:51.999+0000 7fa6717f9700 1 Processor -- start 2023-03-06T13:48:52.006 INFO:teuthology.misc.health.smithi086.stderr:2023-03-06T13:48:51.999+0000 7fa6717f9700 1 -- start start 2023-03-06T13:48:52.006 INFO:teuthology.misc.health.smithi086.stderr:2023-03-06T13:48:51.999+0000 7fa6717f9700 1 --2- >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fa66c0c1a50 0x7fa66c147730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:48:52.006 INFO:teuthology.misc.health.smithi086.stderr:2023-03-06T13:48:51.999+0000 7fa6717f9700 1 --2- >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7fa66c0c4b00 0x7fa66c0bd860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:48:52.007 INFO:teuthology.misc.health.smithi086.stderr:2023-03-06T13:48:51.999+0000 7fa6717f9700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa66c1534e0 0x7fa66c0bdda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:48:52.007 INFO:teuthology.misc.health.smithi086.stderr:2023-03-06T13:48:51.999+0000 7fa6717f9700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa66c14eef0 con 0x7fa66c1534e0 2023-03-06T13:48:52.007 INFO:teuthology.misc.health.smithi086.stderr:2023-03-06T13:48:51.999+0000 7fa6717f9700 1 -- --> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa66c1480f0 con 0x7fa66c0c4b00 2023-03-06T13:48:52.007 INFO:teuthology.misc.health.smithi086.stderr:2023-03-06T13:48:51.999+0000 7fa6717f9700 1 -- --> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa66c0aad20 con 0x7fa66c0c1a50 2023-03-06T13:48:52.007 INFO:teuthology.misc.health.smithi086.stderr:2023-03-06T13:48:51.999+0000 7fa66b7fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa66c1534e0 0x7fa66c0bdda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:48:52.007 INFO:teuthology.misc.health.smithi086.stderr:2023-03-06T13:48:51.999+0000 7fa66b7fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa66c1534e0 0x7fa66c0bdda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:37978/0 (socket says 172.21.15.86:37978) 2023-03-06T13:48:52.007 INFO:teuthology.misc.health.smithi086.stderr:2023-03-06T13:48:51.999+0000 7fa66a7fc700 1 --2- >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7fa66c0c4b00 0x7fa66c0bd860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:48:52.008 INFO:teuthology.misc.health.smithi086.stderr:2023-03-06T13:48:51.999+0000 7fa66b7fe700 1 -- 172.21.15.86:0/2700904341 learned_addr learned my addr 172.21.15.86:0/2700904341 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-03-06T13:48:52.008 INFO:teuthology.misc.health.smithi086.stderr:2023-03-06T13:48:51.999+0000 7fa66affd700 1 --2- 172.21.15.86:0/2700904341 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fa66c0c1a50 0x7fa66c147730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:48:52.008 INFO:teuthology.misc.health.smithi086.stderr:2023-03-06T13:48:52.000+0000 7fa66b7fe700 1 -- 172.21.15.86:0/2700904341 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fa66c0c1a50 msgr2=0x7fa66c147730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:48:52.008 INFO:teuthology.misc.health.smithi086.stderr:2023-03-06T13:48:52.000+0000 7fa66b7fe700 1 --2- 172.21.15.86:0/2700904341 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fa66c0c1a50 0x7fa66c147730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:48:52.008 INFO:teuthology.misc.health.smithi086.stderr:2023-03-06T13:48:52.000+0000 7fa66b7fe700 1 -- 172.21.15.86:0/2700904341 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7fa66c0c4b00 msgr2=0x7fa66c0bd860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:48:52.008 INFO:teuthology.misc.health.smithi086.stderr:2023-03-06T13:48:52.000+0000 7fa66b7fe700 1 --2- 172.21.15.86:0/2700904341 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7fa66c0c4b00 0x7fa66c0bd860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:48:52.009 INFO:teuthology.misc.health.smithi086.stderr:2023-03-06T13:48:52.000+0000 7fa66b7fe700 1 -- 172.21.15.86:0/2700904341 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa65c009a70 con 0x7fa66c1534e0 2023-03-06T13:48:52.009 INFO:teuthology.misc.health.smithi086.stderr:2023-03-06T13:48:52.000+0000 7fa66b7fe700 1 --2- 172.21.15.86:0/2700904341 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa66c1534e0 0x7fa66c0bdda0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fa66400c420 tx=0x7fa66400c730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T13:48:52.009 INFO:teuthology.misc.health.smithi086.stderr:2023-03-06T13:48:52.000+0000 7fa6637fe700 1 -- 172.21.15.86:0/2700904341 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa664005d70 con 0x7fa66c1534e0 2023-03-06T13:48:52.009 INFO:teuthology.misc.health.smithi086.stderr:2023-03-06T13:48:52.000+0000 7fa6637fe700 1 -- 172.21.15.86:0/2700904341 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa66400ce30 con 0x7fa66c1534e0 2023-03-06T13:48:52.010 INFO:teuthology.misc.health.smithi086.stderr:2023-03-06T13:48:52.000+0000 7fa6717f9700 1 -- 172.21.15.86:0/2700904341 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6540094a0 con 0x7fa66c1534e0 2023-03-06T13:48:52.010 INFO:teuthology.misc.health.smithi086.stderr:2023-03-06T13:48:52.000+0000 7fa6637fe700 1 -- 172.21.15.86:0/2700904341 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6640072d0 con 0x7fa66c1534e0 2023-03-06T13:48:52.010 INFO:teuthology.misc.health.smithi086.stderr:2023-03-06T13:48:52.000+0000 7fa6717f9700 1 -- 172.21.15.86:0/2700904341 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa66c152ce0 con 0x7fa66c1534e0 2023-03-06T13:48:52.010 INFO:teuthology.misc.health.smithi086.stderr:2023-03-06T13:48:52.000+0000 7fa6637fe700 1 -- 172.21.15.86:0/2700904341 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 1) v1 ==== 656+0+0 (secure 0 0 0) 0x7fa664019030 con 0x7fa66c1534e0 2023-03-06T13:48:52.010 INFO:teuthology.misc.health.smithi086.stderr:2023-03-06T13:48:52.000+0000 7fa6637fe700 1 -- 172.21.15.86:0/2700904341 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7fa66401c440 con 0x7fa66c1534e0 2023-03-06T13:48:52.011 INFO:teuthology.misc.health.smithi086.stderr:2023-03-06T13:48:52.001+0000 7fa6717f9700 1 -- 172.21.15.86:0/2700904341 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa66c152a00 con 0x7fa66c1534e0 2023-03-06T13:48:52.011 INFO:teuthology.misc.health.smithi086.stderr:2023-03-06T13:48:52.003+0000 7fa6637fe700 1 -- 172.21.15.86:0/2700904341 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7fa664021060 con 0x7fa66c1534e0 2023-03-06T13:48:52.070 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-03-06T13:48:52.068+0000 7efc8307c200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-03-06T13:48:52.076 INFO:teuthology.misc.health.smithi086.stderr:2023-03-06T13:48:52.074+0000 7fa6717f9700 1 -- 172.21.15.86:0/2700904341 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa66c152fc0 con 0x7fa66c1534e0 2023-03-06T13:48:52.077 INFO:teuthology.misc.health.smithi086.stderr:2023-03-06T13:48:52.075+0000 7fa6637fe700 1 -- 172.21.15.86:0/2700904341 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7fa664017070 con 0x7fa66c1534e0 2023-03-06T13:48:52.078 INFO:teuthology.misc.health.smithi086.stdout: 2023-03-06T13:48:52.079 INFO:teuthology.misc.health.smithi086.stdout:{"epoch":10,"fsid":"2cca6c77-50cb-47d8-a8c7-444575d01327","created":"2023-03-06T13:48:48.337369+0000","modified":"2023-03-06T13:48:50.777249+0000","last_up_change":"0.000000","last_in_change":"2023-03-06T13:48:50.777249+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"2de68e69-e10f-49e1-a15a-8a9bfff504c1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"3e75c061-0de5-4742-a20d-4b5a4adb9b81","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"38d71bce-81c2-4e33-91e1-65efb08f2291","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"d95a2686-21bd-4b66-9ea5-eef65403935b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"98c7e359-0f00-496a-8aaa-5472af355e48","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"fa6688d9-73f3-4593-a50e-d96a0fe5f4cf","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"7bfc6dc0-2388-4498-9cd7-766e3606f6a2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"c475f863-96fd-48e3-8033-7d1c3b1d503f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-03-06T13:48:52.080 INFO:teuthology.misc.health.smithi086.stderr:2023-03-06T13:48:52.076+0000 7fa6717f9700 1 -- 172.21.15.86:0/2700904341 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa66c1534e0 msgr2=0x7fa66c0bdda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:48:52.080 INFO:teuthology.misc.health.smithi086.stderr:2023-03-06T13:48:52.076+0000 7fa6717f9700 1 --2- 172.21.15.86:0/2700904341 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa66c1534e0 0x7fa66c0bdda0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fa66400c420 tx=0x7fa66400c730 comp rx=0 tx=0).stop 2023-03-06T13:48:52.080 INFO:teuthology.misc.health.smithi086.stderr:2023-03-06T13:48:52.076+0000 7fa6717f9700 1 -- 172.21.15.86:0/2700904341 shutdown_connections 2023-03-06T13:48:52.080 INFO:teuthology.misc.health.smithi086.stderr:2023-03-06T13:48:52.076+0000 7fa6717f9700 1 --2- 172.21.15.86:0/2700904341 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa66c1534e0 0x7fa66c0bdda0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:48:52.080 INFO:teuthology.misc.health.smithi086.stderr:2023-03-06T13:48:52.076+0000 7fa6717f9700 1 --2- 172.21.15.86:0/2700904341 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fa66c0c1a50 0x7fa66c147730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:48:52.081 INFO:teuthology.misc.health.smithi086.stderr:2023-03-06T13:48:52.076+0000 7fa6717f9700 1 --2- 172.21.15.86:0/2700904341 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7fa66c0c4b00 0x7fa66c0bd860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:48:52.081 INFO:teuthology.misc.health.smithi086.stderr:2023-03-06T13:48:52.076+0000 7fa6717f9700 1 -- 172.21.15.86:0/2700904341 >> 172.21.15.86:0/2700904341 conn(0x7fa66c0c5560 msgr2=0x7fa66c0a72d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T13:48:52.081 INFO:teuthology.misc.health.smithi086.stderr:2023-03-06T13:48:52.076+0000 7fa6717f9700 1 -- 172.21.15.86:0/2700904341 shutdown_connections 2023-03-06T13:48:52.081 INFO:teuthology.misc.health.smithi086.stderr:2023-03-06T13:48:52.076+0000 7fa6717f9700 1 -- 172.21.15.86:0/2700904341 wait complete. 2023-03-06T13:48:52.089 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-03-06T13:48:52.195 INFO:tasks.ceph.mgr.x.smithi202.stderr:2023-03-06T13:48:52.194+0000 7f1742eb7200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-03-06T13:48:52.203 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-03-06T13:48:52.202+0000 7efc8307c200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-03-06T13:48:52.327 INFO:tasks.ceph.mgr.x.smithi202.stderr:2023-03-06T13:48:52.326+0000 7f1742eb7200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-03-06T13:48:52.421 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-03-06T13:48:52.419+0000 7efc8307c200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-03-06T13:48:52.544 INFO:tasks.ceph.mgr.x.smithi202.stderr:2023-03-06T13:48:52.542+0000 7f1742eb7200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-03-06T13:48:52.577 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-03-06T13:48:52.575+0000 7efc8307c200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-03-06T13:48:52.691 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-03-06T13:48:52.689+0000 7efc8307c200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-03-06T13:48:52.697 INFO:tasks.ceph.mgr.x.smithi202.stderr:2023-03-06T13:48:52.696+0000 7f1742eb7200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-03-06T13:48:52.812 INFO:tasks.ceph.mgr.x.smithi202.stderr:2023-03-06T13:48:52.810+0000 7f1742eb7200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-03-06T13:48:53.019 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-03-06T13:48:53.017+0000 7efc8307c200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-03-06T13:48:53.120 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-03-06T13:48:53.117+0000 7efc8307c200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-03-06T13:48:53.135 INFO:tasks.ceph.mgr.x.smithi202.stderr:2023-03-06T13:48:53.134+0000 7f1742eb7200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-03-06T13:48:53.232 INFO:tasks.ceph.mgr.x.smithi202.stderr:2023-03-06T13:48:53.231+0000 7f1742eb7200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-03-06T13:48:53.301 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-03-06T13:48:53.299+0000 7efc8307c200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-03-06T13:48:53.415 INFO:tasks.ceph.mgr.x.smithi202.stderr:2023-03-06T13:48:53.413+0000 7f1742eb7200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-03-06T13:48:53.816 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-03-06T13:48:53.814+0000 7efc8307c200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-03-06T13:48:53.932 INFO:tasks.ceph.mgr.x.smithi202.stderr:2023-03-06T13:48:53.931+0000 7f1742eb7200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-03-06T13:48:54.839 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-03-06T13:48:54.837+0000 7efc3a2e5700 -1 mgr.server handle_report got status from non-daemon mon.b 2023-03-06T13:48:54.840 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-03-06T13:48:54.838+0000 7efc3a2e5700 -1 mgr.server handle_report got status from non-daemon mon.c 2023-03-06T13:48:54.902 INFO:tasks.ceph.osd.1.smithi086.stderr:2023-03-06T13:48:54.900+0000 7f5027152640 -1 osd.1 0 log_to_monitors true 2023-03-06T13:48:54.993 INFO:tasks.ceph.osd.0.smithi086.stderr:2023-03-06T13:48:54.991+0000 7fe6aa6c6640 -1 osd.0 0 log_to_monitors true 2023-03-06T13:48:55.006 INFO:tasks.ceph.osd.4.smithi202.stderr:2023-03-06T13:48:55.005+0000 7f2fa6b5d640 -1 osd.4 0 log_to_monitors true 2023-03-06T13:48:55.008 INFO:tasks.ceph.osd.3.smithi086.stderr:2023-03-06T13:48:55.006+0000 7fc437bf7640 -1 osd.3 0 log_to_monitors true 2023-03-06T13:48:55.012 INFO:tasks.ceph.osd.2.smithi086.stderr:2023-03-06T13:48:55.010+0000 7f097bd16640 -1 osd.2 0 log_to_monitors true 2023-03-06T13:48:55.021 INFO:tasks.ceph.osd.6.smithi202.stderr:2023-03-06T13:48:55.020+0000 7f986ebb5640 -1 osd.6 0 log_to_monitors true 2023-03-06T13:48:55.022 INFO:tasks.ceph.osd.5.smithi202.stderr:2023-03-06T13:48:55.020+0000 7f5e211bb640 -1 osd.5 0 log_to_monitors true 2023-03-06T13:48:55.025 INFO:tasks.ceph.osd.7.smithi202.stderr:2023-03-06T13:48:55.021+0000 7f1137742640 -1 osd.7 0 log_to_monitors true 2023-03-06T13:48:58.769 INFO:tasks.ceph.osd.1.smithi086.stderr:2023-03-06T13:48:58.767+0000 7f501ad09700 -1 osd.1 0 waiting for initial osdmap 2023-03-06T13:48:58.790 INFO:tasks.ceph.osd.1.smithi086.stderr:2023-03-06T13:48:58.782+0000 7f50130e4700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-03-06T13:48:58.851 INFO:tasks.ceph.osd.7.smithi202.stderr:2023-03-06T13:48:58.849+0000 7f112b2f9700 -1 osd.7 0 waiting for initial osdmap 2023-03-06T13:48:58.858 INFO:tasks.ceph.osd.4.smithi202.stderr:2023-03-06T13:48:58.856+0000 7f2f9a714700 -1 osd.4 0 waiting for initial osdmap 2023-03-06T13:48:58.867 INFO:tasks.ceph.osd.7.smithi202.stderr:2023-03-06T13:48:58.866+0000 7f11236d4700 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-03-06T13:48:58.870 INFO:tasks.ceph.osd.4.smithi202.stderr:2023-03-06T13:48:58.869+0000 7f2f92aef700 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-03-06T13:48:58.873 INFO:tasks.ceph.osd.5.smithi202.stderr:2023-03-06T13:48:58.871+0000 7f5e14d72700 -1 osd.5 0 waiting for initial osdmap 2023-03-06T13:48:58.876 INFO:tasks.ceph.osd.0.smithi086.stderr:2023-03-06T13:48:58.875+0000 7fe69e27d700 -1 osd.0 0 waiting for initial osdmap 2023-03-06T13:48:58.877 INFO:tasks.ceph.osd.3.smithi086.stderr:2023-03-06T13:48:58.875+0000 7fc42b7ae700 -1 osd.3 0 waiting for initial osdmap 2023-03-06T13:48:58.887 INFO:tasks.ceph.osd.5.smithi202.stderr:2023-03-06T13:48:58.886+0000 7f5e0d14d700 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-03-06T13:48:58.896 DEBUG:teuthology.orchestra.run.smithi086:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-03-06T13:48:58.897 INFO:tasks.ceph.osd.0.smithi086.stderr:2023-03-06T13:48:58.894+0000 7fe696658700 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-03-06T13:48:58.906 INFO:tasks.ceph.osd.2.smithi086.stderr:2023-03-06T13:48:58.904+0000 7f096f8cd700 -1 osd.2 0 waiting for initial osdmap 2023-03-06T13:48:58.908 INFO:tasks.ceph.osd.3.smithi086.stderr:2023-03-06T13:48:58.907+0000 7fc423b89700 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-03-06T13:48:58.923 INFO:tasks.ceph.osd.2.smithi086.stderr:2023-03-06T13:48:58.921+0000 7f0967ca8700 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-03-06T13:48:58.953 INFO:tasks.ceph.osd.6.smithi202.stderr:2023-03-06T13:48:58.951+0000 7f986276c700 -1 osd.6 0 waiting for initial osdmap 2023-03-06T13:48:58.962 INFO:tasks.ceph.osd.6.smithi202.stderr:2023-03-06T13:48:58.961+0000 7f985ab47700 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-03-06T13:48:59.009 INFO:teuthology.misc.health.smithi086.stderr:2023-03-06T13:48:59.007+0000 7f74b69af700 1 Processor -- start 2023-03-06T13:48:59.009 INFO:teuthology.misc.health.smithi086.stderr:2023-03-06T13:48:59.007+0000 7f74b69af700 1 -- start start 2023-03-06T13:48:59.011 INFO:teuthology.misc.health.smithi086.stderr:2023-03-06T13:48:59.008+0000 7f74b69af700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f74b00bf360 0x7f74b006e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:48:59.012 INFO:teuthology.misc.health.smithi086.stderr:2023-03-06T13:48:59.008+0000 7f74b69af700 1 --2- >> v2:172.21.15.202:3300/0 conn(0x7f74b00bf730 0x7f74b0151160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:48:59.012 INFO:teuthology.misc.health.smithi086.stderr:2023-03-06T13:48:59.008+0000 7f74b69af700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74b014d340 con 0x7f74b00b8cf0 2023-03-06T13:48:59.012 INFO:teuthology.misc.health.smithi086.stderr:2023-03-06T13:48:59.008+0000 7f74b69af700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74b0150680 con 0x7f74b00bf360 2023-03-06T13:48:59.012 INFO:teuthology.misc.health.smithi086.stderr:2023-03-06T13:48:59.008+0000 7f74b69af700 1 -- --> v2:172.21.15.202:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74b0150960 con 0x7f74b00bf730 2023-03-06T13:48:59.012 INFO:teuthology.misc.health.smithi086.stderr:2023-03-06T13:48:59.008+0000 7f74affff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f74b00bf360 0x7f74b006e9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:48:59.012 INFO:teuthology.misc.health.smithi086.stderr:2023-03-06T13:48:59.008+0000 7f74af7fe700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f74b00b8cf0 0x7f74b00b9740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:48228/0 (socket says 172.21.15.86:48228) 2023-03-06T13:48:59.012 INFO:teuthology.misc.health.smithi086.stderr:2023-03-06T13:48:59.008+0000 7f74af7fe700 1 -- 172.21.15.86:0/302215458 learned_addr learned my addr 172.21.15.86:0/302215458 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-03-06T13:48:59.013 INFO:teuthology.misc.health.smithi086.stderr:2023-03-06T13:48:59.008+0000 7f74b4f4c700 1 --2- 172.21.15.86:0/302215458 >> v2:172.21.15.202:3300/0 conn(0x7f74b00bf730 0x7f74b0151160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:48:59.013 INFO:teuthology.misc.health.smithi086.stderr:2023-03-06T13:48:59.008+0000 7f74affff700 1 -- 172.21.15.86:0/302215458 >> v2:172.21.15.202:3300/0 conn(0x7f74b00bf730 msgr2=0x7f74b0151160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T13:48:59.013 INFO:teuthology.misc.health.smithi086.stderr:2023-03-06T13:48:59.008+0000 7f74affff700 1 --2- 172.21.15.86:0/302215458 >> v2:172.21.15.202:3300/0 conn(0x7f74b00bf730 0x7f74b0151160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:48:59.013 INFO:teuthology.misc.health.smithi086.stderr:2023-03-06T13:48:59.008+0000 7f74affff700 1 -- 172.21.15.86:0/302215458 >> v1:172.21.15.86:6789/0 conn(0x7f74b00b8cf0 legacy=0x7f74b00b9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:48:59.013 INFO:teuthology.misc.health.smithi086.stderr:2023-03-06T13:48:59.008+0000 7f74affff700 1 -- 172.21.15.86:0/302215458 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74b0150c40 con 0x7f74b00bf360 2023-03-06T13:48:59.013 INFO:teuthology.misc.health.smithi086.stderr:2023-03-06T13:48:59.008+0000 7f74aeffd700 1 -- 172.21.15.86:0/302215458 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4018508689 0 0) 0x7f74b014d340 con 0x7f74b00b8cf0 2023-03-06T13:48:59.014 INFO:teuthology.misc.health.smithi086.stderr:2023-03-06T13:48:59.008+0000 7f74affff700 1 --2- 172.21.15.86:0/302215458 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f74b00bf360 0x7f74b006e9c0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f74b0071570 tx=0x7f74a4009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee12ddb578ebbd4e server_cookie=0 in_seq=0 out_seq=0 2023-03-06T13:48:59.014 INFO:teuthology.misc.health.smithi086.stderr:2023-03-06T13:48:59.009+0000 7f74aeffd700 1 -- 172.21.15.86:0/302215458 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74a4011830 con 0x7f74b00bf360 2023-03-06T13:48:59.014 INFO:teuthology.misc.health.smithi086.stderr:2023-03-06T13:48:59.009+0000 7f74aeffd700 1 -- 172.21.15.86:0/302215458 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74a4011990 con 0x7f74b00bf360 2023-03-06T13:48:59.014 INFO:teuthology.misc.health.smithi086.stderr:2023-03-06T13:48:59.009+0000 7f74aeffd700 1 -- 172.21.15.86:0/302215458 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74a4011d20 con 0x7f74b00bf360 2023-03-06T13:48:59.015 INFO:teuthology.misc.health.smithi086.stderr:2023-03-06T13:48:59.009+0000 7f74b69af700 1 -- 172.21.15.86:0/302215458 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f74b00bf360 msgr2=0x7f74b006e9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:48:59.015 INFO:teuthology.misc.health.smithi086.stderr:2023-03-06T13:48:59.009+0000 7f74b69af700 1 --2- 172.21.15.86:0/302215458 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f74b00bf360 0x7f74b006e9c0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f74b0071570 tx=0x7f74a4009b20 comp rx=0 tx=0).stop 2023-03-06T13:48:59.015 INFO:teuthology.misc.health.smithi086.stderr:2023-03-06T13:48:59.009+0000 7f74b69af700 1 -- 172.21.15.86:0/302215458 shutdown_connections 2023-03-06T13:48:59.015 INFO:teuthology.misc.health.smithi086.stderr:2023-03-06T13:48:59.009+0000 7f74b69af700 1 --2- 172.21.15.86:0/302215458 >> v2:172.21.15.202:3300/0 conn(0x7f74b00bf730 0x7f74b0151160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:48:59.015 INFO:teuthology.misc.health.smithi086.stderr:2023-03-06T13:48:59.009+0000 7f74b69af700 1 --2- 172.21.15.86:0/302215458 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f74b00bf360 0x7f74b006e9c0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:48:59.015 INFO:teuthology.misc.health.smithi086.stderr:2023-03-06T13:48:59.009+0000 7f74b69af700 1 -- 172.21.15.86:0/302215458 >> 172.21.15.86:0/302215458 conn(0x7f74b00c3270 msgr2=0x7f74b00c3670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T13:48:59.015 INFO:teuthology.misc.health.smithi086.stderr:2023-03-06T13:48:59.009+0000 7f74b69af700 1 -- 172.21.15.86:0/302215458 shutdown_connections 2023-03-06T13:48:59.015 INFO:teuthology.misc.health.smithi086.stderr:2023-03-06T13:48:59.009+0000 7f74b69af700 1 -- 172.21.15.86:0/302215458 wait complete. 2023-03-06T13:48:59.018 INFO:teuthology.misc.health.smithi086.stderr:2023-03-06T13:48:59.010+0000 7f74b69af700 1 Processor -- start 2023-03-06T13:48:59.018 INFO:teuthology.misc.health.smithi086.stderr:2023-03-06T13:48:59.010+0000 7f74b69af700 1 -- start start 2023-03-06T13:48:59.019 INFO:teuthology.misc.health.smithi086.stderr:2023-03-06T13:48:59.011+0000 7f74b69af700 1 --2- >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f74b00b8cf0 0x7f74b00a8190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:48:59.019 INFO:teuthology.misc.health.smithi086.stderr:2023-03-06T13:48:59.011+0000 7f74b69af700 1 --2- >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f74b00bf360 0x7f74b00bb270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:48:59.019 INFO:teuthology.misc.health.smithi086.stderr:2023-03-06T13:48:59.011+0000 7f74b69af700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f74b00bf730 0x7f74b01e5e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:48:59.019 INFO:teuthology.misc.health.smithi086.stderr:2023-03-06T13:48:59.011+0000 7f74b69af700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74b00a9330 con 0x7f74b00bf730 2023-03-06T13:48:59.019 INFO:teuthology.misc.health.smithi086.stderr:2023-03-06T13:48:59.011+0000 7f74b69af700 1 -- --> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74b00ba8f0 con 0x7f74b00bf360 2023-03-06T13:48:59.019 INFO:teuthology.misc.health.smithi086.stderr:2023-03-06T13:48:59.011+0000 7f74b69af700 1 -- --> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74b00a86d0 con 0x7f74b00b8cf0 2023-03-06T13:48:59.020 INFO:teuthology.misc.health.smithi086.stderr:2023-03-06T13:48:59.011+0000 7f74b4f4c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f74b00bf730 0x7f74b01e5e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:48:59.020 INFO:teuthology.misc.health.smithi086.stderr:2023-03-06T13:48:59.011+0000 7f74b4f4c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f74b00bf730 0x7f74b01e5e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:38090/0 (socket says 172.21.15.86:38090) 2023-03-06T13:48:59.020 INFO:teuthology.misc.health.smithi086.stderr:2023-03-06T13:48:59.011+0000 7f74b4f4c700 1 -- 172.21.15.86:0/1581370291 learned_addr learned my addr 172.21.15.86:0/1581370291 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-03-06T13:48:59.020 INFO:teuthology.misc.health.smithi086.stderr:2023-03-06T13:48:59.011+0000 7f74affff700 1 --2- 172.21.15.86:0/1581370291 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f74b00b8cf0 0x7f74b00a8190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:48:59.020 INFO:teuthology.misc.health.smithi086.stderr:2023-03-06T13:48:59.011+0000 7f74af7fe700 1 --2- 172.21.15.86:0/1581370291 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f74b00bf360 0x7f74b00bb270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:48:59.020 INFO:teuthology.misc.health.smithi086.stderr:2023-03-06T13:48:59.011+0000 7f74b4f4c700 1 -- 172.21.15.86:0/1581370291 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f74b00b8cf0 msgr2=0x7f74b00a8190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:48:59.020 INFO:teuthology.misc.health.smithi086.stderr:2023-03-06T13:48:59.011+0000 7f74b4f4c700 1 --2- 172.21.15.86:0/1581370291 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f74b00b8cf0 0x7f74b00a8190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:48:59.021 INFO:teuthology.misc.health.smithi086.stderr:2023-03-06T13:48:59.011+0000 7f74b4f4c700 1 -- 172.21.15.86:0/1581370291 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f74b00bf360 msgr2=0x7f74b00bb270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:48:59.021 INFO:teuthology.misc.health.smithi086.stderr:2023-03-06T13:48:59.011+0000 7f74b4f4c700 1 --2- 172.21.15.86:0/1581370291 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f74b00bf360 0x7f74b00bb270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:48:59.021 INFO:teuthology.misc.health.smithi086.stderr:2023-03-06T13:48:59.011+0000 7f74b4f4c700 1 -- 172.21.15.86:0/1581370291 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74a40094a0 con 0x7f74b00bf730 2023-03-06T13:48:59.021 INFO:teuthology.misc.health.smithi086.stderr:2023-03-06T13:48:59.012+0000 7f74b4f4c700 1 --2- 172.21.15.86:0/1581370291 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f74b00bf730 0x7f74b01e5e40 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f74a8007e70 tx=0x7f74a800e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T13:48:59.021 INFO:teuthology.misc.health.smithi086.stderr:2023-03-06T13:48:59.012+0000 7f74acff9700 1 -- 172.21.15.86:0/1581370291 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74a800ed30 con 0x7f74b00bf730 2023-03-06T13:48:59.021 INFO:teuthology.misc.health.smithi086.stderr:2023-03-06T13:48:59.012+0000 7f74acff9700 1 -- 172.21.15.86:0/1581370291 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74a800eeb0 con 0x7f74b00bf730 2023-03-06T13:48:59.021 INFO:teuthology.misc.health.smithi086.stderr:2023-03-06T13:48:59.012+0000 7f74b69af700 1 -- 172.21.15.86:0/1581370291 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74b00700a0 con 0x7f74b00bf730 2023-03-06T13:48:59.022 INFO:teuthology.misc.health.smithi086.stderr:2023-03-06T13:48:59.012+0000 7f74acff9700 1 -- 172.21.15.86:0/1581370291 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74a8014640 con 0x7f74b00bf730 2023-03-06T13:48:59.022 INFO:teuthology.misc.health.smithi086.stderr:2023-03-06T13:48:59.012+0000 7f74b69af700 1 -- 172.21.15.86:0/1581370291 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74b00b9240 con 0x7f74b00bf730 2023-03-06T13:48:59.022 INFO:teuthology.misc.health.smithi086.stderr:2023-03-06T13:48:59.013+0000 7f74b69af700 1 -- 172.21.15.86:0/1581370291 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74b014cfa0 con 0x7f74b00bf730 2023-03-06T13:48:59.022 INFO:teuthology.misc.health.smithi086.stderr:2023-03-06T13:48:59.013+0000 7f74acff9700 1 -- 172.21.15.86:0/1581370291 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 4) v1 ==== 86375+0+0 (secure 0 0 0) 0x7f74a8012050 con 0x7f74b00bf730 2023-03-06T13:48:59.022 INFO:teuthology.misc.health.smithi086.stderr:2023-03-06T13:48:59.014+0000 7f74acff9700 1 --2- 172.21.15.86:0/1581370291 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7f749c0682d0 0x7f749c06a780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:48:59.022 INFO:teuthology.misc.health.smithi086.stderr:2023-03-06T13:48:59.014+0000 7f74affff700 1 --2- 172.21.15.86:0/1581370291 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7f749c0682d0 0x7f749c06a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:48:59.022 INFO:teuthology.misc.health.smithi086.stderr:2023-03-06T13:48:59.014+0000 7f74acff9700 1 -- 172.21.15.86:0/1581370291 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2231+0+0 (secure 0 0 0) 0x7f74a8085200 con 0x7f74b00bf730 2023-03-06T13:48:59.023 INFO:teuthology.misc.health.smithi086.stderr:2023-03-06T13:48:59.014+0000 7f74affff700 1 --2- 172.21.15.86:0/1581370291 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7f749c0682d0 0x7f749c06a780 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f74a40090b0 tx=0x7f74a401c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T13:48:59.023 INFO:teuthology.misc.health.smithi086.stderr:2023-03-06T13:48:59.018+0000 7f74acff9700 1 -- 172.21.15.86:0/1581370291 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f74a80529a0 con 0x7f74b00bf730 2023-03-06T13:48:59.202 INFO:teuthology.misc.health.smithi086.stderr:2023-03-06T13:48:59.201+0000 7f74b69af700 1 -- 172.21.15.86:0/1581370291 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f74b00b8720 con 0x7f74b00bf730 2023-03-06T13:48:59.203 INFO:teuthology.misc.health.smithi086.stderr:2023-03-06T13:48:59.201+0000 7f74acff9700 1 -- 172.21.15.86:0/1581370291 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f74a8055fc0 con 0x7f74b00bf730 2023-03-06T13:48:59.204 INFO:teuthology.misc.health.smithi086.stdout: 2023-03-06T13:48:59.204 INFO:teuthology.misc.health.smithi086.stdout:{"epoch":12,"fsid":"2cca6c77-50cb-47d8-a8c7-444575d01327","created":"2023-03-06T13:48:48.337369+0000","modified":"2023-03-06T13:48:56.834772+0000","last_up_change":"0.000000","last_in_change":"2023-03-06T13:48:50.777249+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"2de68e69-e10f-49e1-a15a-8a9bfff504c1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"3e75c061-0de5-4742-a20d-4b5a4adb9b81","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"38d71bce-81c2-4e33-91e1-65efb08f2291","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"d95a2686-21bd-4b66-9ea5-eef65403935b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"98c7e359-0f00-496a-8aaa-5472af355e48","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"fa6688d9-73f3-4593-a50e-d96a0fe5f4cf","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"7bfc6dc0-2388-4498-9cd7-766e3606f6a2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"c475f863-96fd-48e3-8033-7d1c3b1d503f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-03-06T13:48:59.205 INFO:teuthology.misc.health.smithi086.stderr:2023-03-06T13:48:59.203+0000 7f74b69af700 1 -- 172.21.15.86:0/1581370291 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7f749c0682d0 msgr2=0x7f749c06a780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:48:59.205 INFO:teuthology.misc.health.smithi086.stderr:2023-03-06T13:48:59.203+0000 7f74b69af700 1 --2- 172.21.15.86:0/1581370291 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7f749c0682d0 0x7f749c06a780 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f74a40090b0 tx=0x7f74a401c040 comp rx=0 tx=0).stop 2023-03-06T13:48:59.206 INFO:teuthology.misc.health.smithi086.stderr:2023-03-06T13:48:59.203+0000 7f74b69af700 1 -- 172.21.15.86:0/1581370291 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f74b00bf730 msgr2=0x7f74b01e5e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:48:59.206 INFO:teuthology.misc.health.smithi086.stderr:2023-03-06T13:48:59.203+0000 7f74b69af700 1 --2- 172.21.15.86:0/1581370291 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f74b00bf730 0x7f74b01e5e40 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f74a8007e70 tx=0x7f74a800e3c0 comp rx=0 tx=0).stop 2023-03-06T13:48:59.206 INFO:teuthology.misc.health.smithi086.stderr:2023-03-06T13:48:59.203+0000 7f74b69af700 1 -- 172.21.15.86:0/1581370291 shutdown_connections 2023-03-06T13:48:59.206 INFO:teuthology.misc.health.smithi086.stderr:2023-03-06T13:48:59.203+0000 7f74b69af700 1 --2- 172.21.15.86:0/1581370291 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7f749c0682d0 0x7f749c06a780 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:48:59.206 INFO:teuthology.misc.health.smithi086.stderr:2023-03-06T13:48:59.203+0000 7f74b69af700 1 --2- 172.21.15.86:0/1581370291 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f74b00bf730 0x7f74b01e5e40 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:48:59.206 INFO:teuthology.misc.health.smithi086.stderr:2023-03-06T13:48:59.203+0000 7f74b69af700 1 --2- 172.21.15.86:0/1581370291 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f74b00b8cf0 0x7f74b00a8190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:48:59.206 INFO:teuthology.misc.health.smithi086.stderr:2023-03-06T13:48:59.203+0000 7f74b69af700 1 --2- 172.21.15.86:0/1581370291 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f74b00bf360 0x7f74b00bb270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:48:59.207 INFO:teuthology.misc.health.smithi086.stderr:2023-03-06T13:48:59.203+0000 7f74b69af700 1 -- 172.21.15.86:0/1581370291 >> 172.21.15.86:0/1581370291 conn(0x7f74b00c3270 msgr2=0x7f74b00b9760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T13:48:59.207 INFO:teuthology.misc.health.smithi086.stderr:2023-03-06T13:48:59.203+0000 7f74b69af700 1 -- 172.21.15.86:0/1581370291 shutdown_connections 2023-03-06T13:48:59.207 INFO:teuthology.misc.health.smithi086.stderr:2023-03-06T13:48:59.203+0000 7f74b69af700 1 -- 172.21.15.86:0/1581370291 wait complete. 2023-03-06T13:48:59.216 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-03-06T13:49:06.023 DEBUG:teuthology.orchestra.run.smithi086:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-03-06T13:49:06.145 INFO:teuthology.misc.health.smithi086.stderr:2023-03-06T13:49:06.144+0000 7fab6ba8c700 1 Processor -- start 2023-03-06T13:49:06.146 INFO:teuthology.misc.health.smithi086.stderr:2023-03-06T13:49:06.145+0000 7fab6ba8c700 1 -- start start 2023-03-06T13:49:06.148 INFO:teuthology.misc.health.smithi086.stderr:2023-03-06T13:49:06.145+0000 7fab6ba8c700 1 --2- >> v2:172.21.15.202:3300/0 conn(0x7fab6406a330 0x7fab640bd8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:06.149 INFO:teuthology.misc.health.smithi086.stderr:2023-03-06T13:49:06.145+0000 7fab6ba8c700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab640bcae0 con 0x7fab6406e950 2023-03-06T13:49:06.149 INFO:teuthology.misc.health.smithi086.stderr:2023-03-06T13:49:06.145+0000 7fab6ba8c700 1 -- --> v1:172.21.15.202:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab6406d920 con 0x7fab64157a90 2023-03-06T13:49:06.149 INFO:teuthology.misc.health.smithi086.stderr:2023-03-06T13:49:06.145+0000 7fab6ba8c700 1 -- --> v2:172.21.15.202:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab6406ae10 con 0x7fab6406a330 2023-03-06T13:49:06.149 INFO:teuthology.misc.health.smithi086.stderr:2023-03-06T13:49:06.146+0000 7fab69027700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7fab6406e950 0x7fab6406a700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:48456/0 (socket says 172.21.15.86:48456) 2023-03-06T13:49:06.149 INFO:teuthology.misc.health.smithi086.stderr:2023-03-06T13:49:06.146+0000 7fab69027700 1 -- 172.21.15.86:0/480845332 learned_addr learned my addr 172.21.15.86:0/480845332 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-03-06T13:49:06.150 INFO:teuthology.misc.health.smithi086.stderr:2023-03-06T13:49:06.146+0000 7fab68826700 1 -- 172.21.15.86:0/480845332 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2119385 0 0) 0x7fab640bcae0 con 0x7fab6406e950 2023-03-06T13:49:06.150 INFO:teuthology.misc.health.smithi086.stderr:2023-03-06T13:49:06.146+0000 7fab68826700 1 -- 172.21.15.86:0/480845332 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fab500035b0 con 0x7fab6406e950 2023-03-06T13:49:06.150 INFO:teuthology.misc.health.smithi086.stderr:2023-03-06T13:49:06.146+0000 7fab69828700 1 --2- 172.21.15.86:0/480845332 >> v2:172.21.15.202:3300/0 conn(0x7fab6406a330 0x7fab640bd8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:06.150 INFO:teuthology.misc.health.smithi086.stderr:2023-03-06T13:49:06.146+0000 7fab68826700 1 -- 172.21.15.86:0/480845332 <== mon.0 v1:172.21.15.86:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 12761521 0 0) 0x7fab500035b0 con 0x7fab6406e950 2023-03-06T13:49:06.150 INFO:teuthology.misc.health.smithi086.stderr:2023-03-06T13:49:06.146+0000 7fab68826700 1 -- 172.21.15.86:0/480845332 >> v2:172.21.15.202:3300/0 conn(0x7fab6406a330 msgr2=0x7fab640bd8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T13:49:06.150 INFO:teuthology.misc.health.smithi086.stderr:2023-03-06T13:49:06.146+0000 7fab68826700 1 --2- 172.21.15.86:0/480845332 >> v2:172.21.15.202:3300/0 conn(0x7fab6406a330 0x7fab640bd8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:06.150 INFO:teuthology.misc.health.smithi086.stderr:2023-03-06T13:49:06.146+0000 7fab68826700 1 -- 172.21.15.86:0/480845332 >> v1:172.21.15.202:6789/0 conn(0x7fab64157a90 legacy=0x7fab64159e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:06.151 INFO:teuthology.misc.health.smithi086.stderr:2023-03-06T13:49:06.146+0000 7fab68826700 1 -- 172.21.15.86:0/480845332 --> v1:172.21.15.86:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab640bcd30 con 0x7fab6406e950 2023-03-06T13:49:06.151 INFO:teuthology.misc.health.smithi086.stderr:2023-03-06T13:49:06.146+0000 7fab68826700 1 -- 172.21.15.86:0/480845332 <== mon.0 v1:172.21.15.86:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2191261126 0 0) 0x7fab60001670 con 0x7fab6406e950 2023-03-06T13:49:06.151 INFO:teuthology.misc.health.smithi086.stderr:2023-03-06T13:49:06.146+0000 7fab68826700 1 -- 172.21.15.86:0/480845332 >> v1:172.21.15.86:6789/0 conn(0x7fab6406e950 legacy=0x7fab6406a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:06.151 INFO:teuthology.misc.health.smithi086.stderr:2023-03-06T13:49:06.146+0000 7fab68826700 1 --2- 172.21.15.86:0/480845332 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fab50003a70 0x7fab50003e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:06.151 INFO:teuthology.misc.health.smithi086.stderr:2023-03-06T13:49:06.146+0000 7fab68826700 1 --2- 172.21.15.86:0/480845332 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fab50004850 0x7fab50004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:06.151 INFO:teuthology.misc.health.smithi086.stderr:2023-03-06T13:49:06.146+0000 7fab68826700 1 --2- 172.21.15.86:0/480845332 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7fab50005200 0x7fab5000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:06.151 INFO:teuthology.misc.health.smithi086.stderr:2023-03-06T13:49:06.146+0000 7fab68826700 1 -- 172.21.15.86:0/480845332 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab6406ae10 con 0x7fab50003a70 2023-03-06T13:49:06.152 INFO:teuthology.misc.health.smithi086.stderr:2023-03-06T13:49:06.146+0000 7fab68826700 1 -- 172.21.15.86:0/480845332 --> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab5000c0e0 con 0x7fab50005200 2023-03-06T13:49:06.152 INFO:teuthology.misc.health.smithi086.stderr:2023-03-06T13:49:06.146+0000 7fab68826700 1 -- 172.21.15.86:0/480845332 --> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab5000c2a0 con 0x7fab50004850 2023-03-06T13:49:06.152 INFO:teuthology.misc.health.smithi086.stderr:2023-03-06T13:49:06.146+0000 7fab69828700 1 --2- 172.21.15.86:0/480845332 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fab50003a70 0x7fab50003e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:06.152 INFO:teuthology.misc.health.smithi086.stderr:2023-03-06T13:49:06.146+0000 7fab6a029700 1 --2- 172.21.15.86:0/480845332 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7fab50005200 0x7fab5000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:06.152 INFO:teuthology.misc.health.smithi086.stderr:2023-03-06T13:49:06.146+0000 7fab69027700 1 --2- 172.21.15.86:0/480845332 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fab50004850 0x7fab50004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:06.152 INFO:teuthology.misc.health.smithi086.stderr:2023-03-06T13:49:06.147+0000 7fab69828700 1 -- 172.21.15.86:0/480845332 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fab50004850 msgr2=0x7fab50004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T13:49:06.152 INFO:teuthology.misc.health.smithi086.stderr:2023-03-06T13:49:06.147+0000 7fab69828700 1 --2- 172.21.15.86:0/480845332 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fab50004850 0x7fab50004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:06.153 INFO:teuthology.misc.health.smithi086.stderr:2023-03-06T13:49:06.147+0000 7fab69828700 1 -- 172.21.15.86:0/480845332 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7fab50005200 msgr2=0x7fab5000ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T13:49:06.153 INFO:teuthology.misc.health.smithi086.stderr:2023-03-06T13:49:06.147+0000 7fab69828700 1 --2- 172.21.15.86:0/480845332 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7fab50005200 0x7fab5000ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:06.153 INFO:teuthology.misc.health.smithi086.stderr:2023-03-06T13:49:06.147+0000 7fab6a029700 1 -- 172.21.15.86:0/480845332 reap_dead start 2023-03-06T13:49:06.153 INFO:teuthology.misc.health.smithi086.stderr:2023-03-06T13:49:06.147+0000 7fab69828700 1 -- 172.21.15.86:0/480845332 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab500035b0 con 0x7fab50003a70 2023-03-06T13:49:06.153 INFO:teuthology.misc.health.smithi086.stderr:2023-03-06T13:49:06.147+0000 7fab69027700 1 --2- 172.21.15.86:0/480845332 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fab50004850 0x7fab50004cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-06T13:49:06.153 INFO:teuthology.misc.health.smithi086.stderr:2023-03-06T13:49:06.147+0000 7fab69828700 1 --2- 172.21.15.86:0/480845332 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fab50003a70 0x7fab50003e80 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fab54009b60 tx=0x7fab50005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdfaad94d14ccfd8 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T13:49:06.153 INFO:teuthology.misc.health.smithi086.stderr:2023-03-06T13:49:06.147+0000 7fab68826700 1 -- 172.21.15.86:0/480845332 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab5400e6c0 con 0x7fab50003a70 2023-03-06T13:49:06.154 INFO:teuthology.misc.health.smithi086.stderr:2023-03-06T13:49:06.147+0000 7fab68826700 1 -- 172.21.15.86:0/480845332 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab5400e820 con 0x7fab50003a70 2023-03-06T13:49:06.154 INFO:teuthology.misc.health.smithi086.stderr:2023-03-06T13:49:06.147+0000 7fab68826700 1 -- 172.21.15.86:0/480845332 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab5400eb90 con 0x7fab50003a70 2023-03-06T13:49:06.154 INFO:teuthology.misc.health.smithi086.stderr:2023-03-06T13:49:06.147+0000 7fab6ba8c700 1 -- 172.21.15.86:0/480845332 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fab50003a70 msgr2=0x7fab50003e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:06.154 INFO:teuthology.misc.health.smithi086.stderr:2023-03-06T13:49:06.147+0000 7fab6ba8c700 1 --2- 172.21.15.86:0/480845332 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fab50003a70 0x7fab50003e80 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fab54009b60 tx=0x7fab50005880 comp rx=0 tx=0).stop 2023-03-06T13:49:06.154 INFO:teuthology.misc.health.smithi086.stderr:2023-03-06T13:49:06.147+0000 7fab6ba8c700 1 -- 172.21.15.86:0/480845332 shutdown_connections 2023-03-06T13:49:06.154 INFO:teuthology.misc.health.smithi086.stderr:2023-03-06T13:49:06.147+0000 7fab6ba8c700 1 --2- 172.21.15.86:0/480845332 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fab50003a70 0x7fab50003e80 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:06.154 INFO:teuthology.misc.health.smithi086.stderr:2023-03-06T13:49:06.147+0000 7fab6ba8c700 1 -- 172.21.15.86:0/480845332 >> 172.21.15.86:0/480845332 conn(0x7fab6406b440 msgr2=0x7fab6406b840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T13:49:06.156 INFO:teuthology.misc.health.smithi086.stderr:2023-03-06T13:49:06.148+0000 7fab6ba8c700 1 -- 172.21.15.86:0/480845332 shutdown_connections 2023-03-06T13:49:06.156 INFO:teuthology.misc.health.smithi086.stderr:2023-03-06T13:49:06.148+0000 7fab6ba8c700 1 -- 172.21.15.86:0/480845332 wait complete. 2023-03-06T13:49:06.159 INFO:teuthology.misc.health.smithi086.stderr:2023-03-06T13:49:06.149+0000 7fab6ba8c700 1 Processor -- start 2023-03-06T13:49:06.159 INFO:teuthology.misc.health.smithi086.stderr:2023-03-06T13:49:06.149+0000 7fab6ba8c700 1 -- start start 2023-03-06T13:49:06.159 INFO:teuthology.misc.health.smithi086.stderr:2023-03-06T13:49:06.149+0000 7fab6ba8c700 1 --2- >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fab50003a70 0x7fab640c0540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:06.159 INFO:teuthology.misc.health.smithi086.stderr:2023-03-06T13:49:06.149+0000 7fab6ba8c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fab640bf500 0x7fab640a6760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:06.159 INFO:teuthology.misc.health.smithi086.stderr:2023-03-06T13:49:06.149+0000 7fab6ba8c700 1 --2- >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7fab64142580 0x7fab641e8500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:06.159 INFO:teuthology.misc.health.smithi086.stderr:2023-03-06T13:49:06.149+0000 7fab6ba8c700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab640c0060 con 0x7fab640bf500 2023-03-06T13:49:06.160 INFO:teuthology.misc.health.smithi086.stderr:2023-03-06T13:49:06.149+0000 7fab6ba8c700 1 -- --> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab641377c0 con 0x7fab64142580 2023-03-06T13:49:06.160 INFO:teuthology.misc.health.smithi086.stderr:2023-03-06T13:49:06.149+0000 7fab6ba8c700 1 -- --> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab641374e0 con 0x7fab50003a70 2023-03-06T13:49:06.160 INFO:teuthology.misc.health.smithi086.stderr:2023-03-06T13:49:06.149+0000 7fab69027700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fab640bf500 0x7fab640a6760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:06.160 INFO:teuthology.misc.health.smithi086.stderr:2023-03-06T13:49:06.149+0000 7fab69027700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fab640bf500 0x7fab640a6760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:38322/0 (socket says 172.21.15.86:38322) 2023-03-06T13:49:06.160 INFO:teuthology.misc.health.smithi086.stderr:2023-03-06T13:49:06.149+0000 7fab69027700 1 -- 172.21.15.86:0/3078124060 learned_addr learned my addr 172.21.15.86:0/3078124060 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-03-06T13:49:06.160 INFO:teuthology.misc.health.smithi086.stderr:2023-03-06T13:49:06.149+0000 7fab69828700 1 --2- 172.21.15.86:0/3078124060 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fab50003a70 0x7fab640c0540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:06.160 INFO:teuthology.misc.health.smithi086.stderr:2023-03-06T13:49:06.149+0000 7fab6a029700 1 --2- 172.21.15.86:0/3078124060 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7fab64142580 0x7fab641e8500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:06.161 INFO:teuthology.misc.health.smithi086.stderr:2023-03-06T13:49:06.150+0000 7fab69027700 1 -- 172.21.15.86:0/3078124060 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fab50003a70 msgr2=0x7fab640c0540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:06.161 INFO:teuthology.misc.health.smithi086.stderr:2023-03-06T13:49:06.150+0000 7fab69027700 1 --2- 172.21.15.86:0/3078124060 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fab50003a70 0x7fab640c0540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:06.161 INFO:teuthology.misc.health.smithi086.stderr:2023-03-06T13:49:06.150+0000 7fab69027700 1 -- 172.21.15.86:0/3078124060 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7fab64142580 msgr2=0x7fab641e8500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:06.161 INFO:teuthology.misc.health.smithi086.stderr:2023-03-06T13:49:06.150+0000 7fab69027700 1 --2- 172.21.15.86:0/3078124060 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7fab64142580 0x7fab641e8500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:06.161 INFO:teuthology.misc.health.smithi086.stderr:2023-03-06T13:49:06.150+0000 7fab69027700 1 -- 172.21.15.86:0/3078124060 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab64150000 con 0x7fab640bf500 2023-03-06T13:49:06.161 INFO:teuthology.misc.health.smithi086.stderr:2023-03-06T13:49:06.150+0000 7fab69027700 1 --2- 172.21.15.86:0/3078124060 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fab640bf500 0x7fab640a6760 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fab6000e7b0 tx=0x7fab6000eac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T13:49:06.161 INFO:teuthology.misc.health.smithi086.stderr:2023-03-06T13:49:06.150+0000 7fab5a7fc700 1 -- 172.21.15.86:0/3078124060 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab60010510 con 0x7fab640bf500 2023-03-06T13:49:06.162 INFO:teuthology.misc.health.smithi086.stderr:2023-03-06T13:49:06.150+0000 7fab5a7fc700 1 -- 172.21.15.86:0/3078124060 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab60010670 con 0x7fab640bf500 2023-03-06T13:49:06.162 INFO:teuthology.misc.health.smithi086.stderr:2023-03-06T13:49:06.150+0000 7fab6ba8c700 1 -- 172.21.15.86:0/3078124060 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab6414fd20 con 0x7fab640bf500 2023-03-06T13:49:06.162 INFO:teuthology.misc.health.smithi086.stderr:2023-03-06T13:49:06.150+0000 7fab5a7fc700 1 -- 172.21.15.86:0/3078124060 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab60010a00 con 0x7fab640bf500 2023-03-06T13:49:06.162 INFO:teuthology.misc.health.smithi086.stderr:2023-03-06T13:49:06.150+0000 7fab6ba8c700 1 -- 172.21.15.86:0/3078124060 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab6414ccd0 con 0x7fab640bf500 2023-03-06T13:49:06.162 INFO:teuthology.misc.health.smithi086.stderr:2023-03-06T13:49:06.151+0000 7fab6ba8c700 1 -- 172.21.15.86:0/3078124060 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab64061f40 con 0x7fab640bf500 2023-03-06T13:49:06.162 INFO:teuthology.misc.health.smithi086.stderr:2023-03-06T13:49:06.151+0000 7fab5a7fc700 1 -- 172.21.15.86:0/3078124060 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fab6001b030 con 0x7fab640bf500 2023-03-06T13:49:06.162 INFO:teuthology.misc.health.smithi086.stderr:2023-03-06T13:49:06.152+0000 7fab5a7fc700 1 --2- 172.21.15.86:0/3078124060 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7fab480682f0 0x7fab4806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:06.162 INFO:teuthology.misc.health.smithi086.stderr:2023-03-06T13:49:06.152+0000 7fab5a7fc700 1 -- 172.21.15.86:0/3078124060 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fab60084e50 con 0x7fab640bf500 2023-03-06T13:49:06.163 INFO:teuthology.misc.health.smithi086.stderr:2023-03-06T13:49:06.152+0000 7fab69828700 1 --2- 172.21.15.86:0/3078124060 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7fab480682f0 0x7fab4806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:06.163 INFO:teuthology.misc.health.smithi086.stderr:2023-03-06T13:49:06.152+0000 7fab69828700 1 --2- 172.21.15.86:0/3078124060 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7fab480682f0 0x7fab4806a7a0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fab540090b0 tx=0x7fab5401f040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T13:49:06.163 INFO:teuthology.misc.health.smithi086.stderr:2023-03-06T13:49:06.156+0000 7fab5a7fc700 1 -- 172.21.15.86:0/3078124060 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fab6004d5e0 con 0x7fab640bf500 2023-03-06T13:49:06.342 INFO:teuthology.misc.health.smithi086.stderr:2023-03-06T13:49:06.341+0000 7fab6ba8c700 1 -- 172.21.15.86:0/3078124060 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fab640714b0 con 0x7fab640bf500 2023-03-06T13:49:06.343 INFO:teuthology.misc.health.smithi086.stderr:2023-03-06T13:49:06.342+0000 7fab5a7fc700 1 -- 172.21.15.86:0/3078124060 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12382 (secure 0 0 0) 0x7fab60019030 con 0x7fab640bf500 2023-03-06T13:49:06.343 INFO:teuthology.misc.health.smithi086.stdout: 2023-03-06T13:49:06.344 INFO:teuthology.misc.health.smithi086.stdout:{"epoch":16,"fsid":"2cca6c77-50cb-47d8-a8c7-444575d01327","created":"2023-03-06T13:48:48.337369+0000","modified":"2023-03-06T13:49:02.867777+0000","last_up_change":"2023-03-06T13:48:59.782729+0000","last_in_change":"2023-03-06T13:48:50.777249+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-03-06T13:48:59.879087+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2de68e69-e10f-49e1-a15a-8a9bfff504c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":96739},{"type":"v1","addr":"172.21.15.86:6816","nonce":96739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":96739},{"type":"v1","addr":"172.21.15.86:6819","nonce":96739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":96739},{"type":"v1","addr":"172.21.15.86:6823","nonce":96739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":96739},{"type":"v1","addr":"172.21.15.86:6821","nonce":96739}]},"public_addr":"172.21.15.86:6816/96739","cluster_addr":"172.21.15.86:6819/96739","heartbeat_back_addr":"172.21.15.86:6823/96739","heartbeat_front_addr":"172.21.15.86:6821/96739","state":["exists","up"]},{"osd":1,"uuid":"3e75c061-0de5-4742-a20d-4b5a4adb9b81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":96738},{"type":"v1","addr":"172.21.15.86:6801","nonce":96738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":96738},{"type":"v1","addr":"172.21.15.86:6803","nonce":96738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":96738},{"type":"v1","addr":"172.21.15.86:6807","nonce":96738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":96738},{"type":"v1","addr":"172.21.15.86:6805","nonce":96738}]},"public_addr":"172.21.15.86:6801/96738","cluster_addr":"172.21.15.86:6803/96738","heartbeat_back_addr":"172.21.15.86:6807/96738","heartbeat_front_addr":"172.21.15.86:6805/96738","state":["exists","up"]},{"osd":2,"uuid":"38d71bce-81c2-4e33-91e1-65efb08f2291","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":96740},{"type":"v1","addr":"172.21.15.86:6809","nonce":96740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":96740},{"type":"v1","addr":"172.21.15.86:6811","nonce":96740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6815","nonce":96740},{"type":"v1","addr":"172.21.15.86:6817","nonce":96740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":96740},{"type":"v1","addr":"172.21.15.86:6813","nonce":96740}]},"public_addr":"172.21.15.86:6809/96740","cluster_addr":"172.21.15.86:6811/96740","heartbeat_back_addr":"172.21.15.86:6817/96740","heartbeat_front_addr":"172.21.15.86:6813/96740","state":["exists","up"]},{"osd":3,"uuid":"d95a2686-21bd-4b66-9ea5-eef65403935b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":96756},{"type":"v1","addr":"172.21.15.86:6825","nonce":96756}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":96756},{"type":"v1","addr":"172.21.15.86:6827","nonce":96756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":96756},{"type":"v1","addr":"172.21.15.86:6831","nonce":96756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":96756},{"type":"v1","addr":"172.21.15.86:6829","nonce":96756}]},"public_addr":"172.21.15.86:6825/96756","cluster_addr":"172.21.15.86:6827/96756","heartbeat_back_addr":"172.21.15.86:6831/96756","heartbeat_front_addr":"172.21.15.86:6829/96756","state":["exists","up"]},{"osd":4,"uuid":"98c7e359-0f00-496a-8aaa-5472af355e48","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.202:6816","nonce":96847},{"type":"v1","addr":"172.21.15.202:6817","nonce":96847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.202:6818","nonce":96847},{"type":"v1","addr":"172.21.15.202:6819","nonce":96847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.202:6822","nonce":96847},{"type":"v1","addr":"172.21.15.202:6823","nonce":96847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.202:6820","nonce":96847},{"type":"v1","addr":"172.21.15.202:6821","nonce":96847}]},"public_addr":"172.21.15.202:6817/96847","cluster_addr":"172.21.15.202:6819/96847","heartbeat_back_addr":"172.21.15.202:6823/96847","heartbeat_front_addr":"172.21.15.202:6821/96847","state":["exists","up"]},{"osd":5,"uuid":"fa6688d9-73f3-4593-a50e-d96a0fe5f4cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.202:6824","nonce":96848},{"type":"v1","addr":"172.21.15.202:6825","nonce":96848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.202:6826","nonce":96848},{"type":"v1","addr":"172.21.15.202:6827","nonce":96848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.202:6830","nonce":96848},{"type":"v1","addr":"172.21.15.202:6831","nonce":96848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.202:6828","nonce":96848},{"type":"v1","addr":"172.21.15.202:6829","nonce":96848}]},"public_addr":"172.21.15.202:6825/96848","cluster_addr":"172.21.15.202:6827/96848","heartbeat_back_addr":"172.21.15.202:6831/96848","heartbeat_front_addr":"172.21.15.202:6829/96848","state":["exists","up"]},{"osd":6,"uuid":"7bfc6dc0-2388-4498-9cd7-766e3606f6a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.202:6808","nonce":96845},{"type":"v1","addr":"172.21.15.202:6809","nonce":96845}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.202:6810","nonce":96845},{"type":"v1","addr":"172.21.15.202:6811","nonce":96845}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.202:6814","nonce":96845},{"type":"v1","addr":"172.21.15.202:6815","nonce":96845}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.202:6812","nonce":96845},{"type":"v1","addr":"172.21.15.202:6813","nonce":96845}]},"public_addr":"172.21.15.202:6809/96845","cluster_addr":"172.21.15.202:6811/96845","heartbeat_back_addr":"172.21.15.202:6815/96845","heartbeat_front_addr":"172.21.15.202:6813/96845","state":["exists","up"]},{"osd":7,"uuid":"c475f863-96fd-48e3-8033-7d1c3b1d503f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.202:6800","nonce":96846},{"type":"v1","addr":"172.21.15.202:6801","nonce":96846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.202:6802","nonce":96846},{"type":"v1","addr":"172.21.15.202:6803","nonce":96846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.202:6806","nonce":96846},{"type":"v1","addr":"172.21.15.202:6807","nonce":96846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.202:6804","nonce":96846},{"type":"v1","addr":"172.21.15.202:6805","nonce":96846}]},"public_addr":"172.21.15.202:6801/96846","cluster_addr":"172.21.15.202:6803/96846","heartbeat_back_addr":"172.21.15.202:6807/96846","heartbeat_front_addr":"172.21.15.202:6805/96846","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-06T13:48:55.997991+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-06T13:48:55.930805+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-06T13:48:56.000312+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-06T13:48:55.998360+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-06T13:48:56.052762+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-06T13:48:56.036049+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-06T13:48:56.048751+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-06T13:48:56.011928+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-03-06T13:49:06.346 INFO:teuthology.misc.health.smithi086.stderr:2023-03-06T13:49:06.344+0000 7fab6ba8c700 1 -- 172.21.15.86:0/3078124060 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7fab480682f0 msgr2=0x7fab4806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:06.346 INFO:teuthology.misc.health.smithi086.stderr:2023-03-06T13:49:06.344+0000 7fab6ba8c700 1 --2- 172.21.15.86:0/3078124060 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7fab480682f0 0x7fab4806a7a0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fab540090b0 tx=0x7fab5401f040 comp rx=0 tx=0).stop 2023-03-06T13:49:06.346 INFO:teuthology.misc.health.smithi086.stderr:2023-03-06T13:49:06.344+0000 7fab6ba8c700 1 -- 172.21.15.86:0/3078124060 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fab640bf500 msgr2=0x7fab640a6760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:06.346 INFO:teuthology.misc.health.smithi086.stderr:2023-03-06T13:49:06.344+0000 7fab6ba8c700 1 --2- 172.21.15.86:0/3078124060 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fab640bf500 0x7fab640a6760 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fab6000e7b0 tx=0x7fab6000eac0 comp rx=0 tx=0).stop 2023-03-06T13:49:06.347 INFO:teuthology.misc.health.smithi086.stderr:2023-03-06T13:49:06.344+0000 7fab6ba8c700 1 -- 172.21.15.86:0/3078124060 shutdown_connections 2023-03-06T13:49:06.347 INFO:teuthology.misc.health.smithi086.stderr:2023-03-06T13:49:06.344+0000 7fab6ba8c700 1 --2- 172.21.15.86:0/3078124060 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7fab480682f0 0x7fab4806a7a0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:06.347 INFO:teuthology.misc.health.smithi086.stderr:2023-03-06T13:49:06.344+0000 7fab6ba8c700 1 --2- 172.21.15.86:0/3078124060 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7fab64142580 0x7fab641e8500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:06.348 INFO:teuthology.misc.health.smithi086.stderr:2023-03-06T13:49:06.344+0000 7fab6ba8c700 1 --2- 172.21.15.86:0/3078124060 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fab50003a70 0x7fab640c0540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:06.348 INFO:teuthology.misc.health.smithi086.stderr:2023-03-06T13:49:06.344+0000 7fab6ba8c700 1 --2- 172.21.15.86:0/3078124060 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fab640bf500 0x7fab640a6760 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:06.348 INFO:teuthology.misc.health.smithi086.stderr:2023-03-06T13:49:06.344+0000 7fab6ba8c700 1 -- 172.21.15.86:0/3078124060 >> 172.21.15.86:0/3078124060 conn(0x7fab6406b440 msgr2=0x7fab641447a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T13:49:06.348 INFO:teuthology.misc.health.smithi086.stderr:2023-03-06T13:49:06.344+0000 7fab6ba8c700 1 -- 172.21.15.86:0/3078124060 shutdown_connections 2023-03-06T13:49:06.348 INFO:teuthology.misc.health.smithi086.stderr:2023-03-06T13:49:06.344+0000 7fab6ba8c700 1 -- 172.21.15.86:0/3078124060 wait complete. 2023-03-06T13:49:06.356 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-03-06T13:49:06.357 INFO:tasks.ceph:Creating RBD pool 2023-03-06T13:49:06.357 DEBUG:teuthology.orchestra.run.smithi086:> sudo ceph --cluster ceph osd pool create rbd 8 2023-03-06T13:49:06.477 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:06.474+0000 7f3acd5ee700 1 Processor -- start 2023-03-06T13:49:06.478 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:06.474+0000 7f3acd5ee700 1 -- start start 2023-03-06T13:49:06.478 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:06.475+0000 7f3acd5ee700 1 --2- >> v2:172.21.15.202:3300/0 conn(0x7f3ac80a6ef0 0x7f3ac80a72c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:06.478 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:06.475+0000 7f3acd5ee700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f3ac80c2b30 0x7f3ac8150720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:06.478 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:06.475+0000 7f3acd5ee700 1 --2- >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f3ac80c25e0 0x7f3ac8150c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:06.479 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:06.475+0000 7f3acd5ee700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ac80c0910 con 0x7f3ac80c2b30 2023-03-06T13:49:06.479 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:06.475+0000 7f3acd5ee700 1 -- --> v2:172.21.15.202:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ac8149770 con 0x7f3ac80a6ef0 2023-03-06T13:49:06.479 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:06.475+0000 7f3acd5ee700 1 -- --> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ac80c1a90 con 0x7f3ac80c25e0 2023-03-06T13:49:06.479 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:06.475+0000 7f3ac67fc700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f3ac80c2b30 0x7f3ac8150720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:06.479 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:06.475+0000 7f3ac67fc700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f3ac80c2b30 0x7f3ac8150720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:38328/0 (socket says 172.21.15.86:38328) 2023-03-06T13:49:06.479 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:06.475+0000 7f3ac67fc700 1 -- 172.21.15.86:0/3841152633 learned_addr learned my addr 172.21.15.86:0/3841152633 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-03-06T13:49:06.480 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:06.475+0000 7f3ac77fe700 1 --2- 172.21.15.86:0/3841152633 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f3ac80c25e0 0x7f3ac8150c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:06.480 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:06.475+0000 7f3ac6ffd700 1 --2- 172.21.15.86:0/3841152633 >> v2:172.21.15.202:3300/0 conn(0x7f3ac80a6ef0 0x7f3ac80a72c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:06.480 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:06.475+0000 7f3ac67fc700 1 -- 172.21.15.86:0/3841152633 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f3ac80c25e0 msgr2=0x7f3ac8150c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T13:49:06.480 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:06.475+0000 7f3ac67fc700 1 --2- 172.21.15.86:0/3841152633 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f3ac80c25e0 0x7f3ac8150c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:06.480 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:06.475+0000 7f3ac67fc700 1 -- 172.21.15.86:0/3841152633 >> v2:172.21.15.202:3300/0 conn(0x7f3ac80a6ef0 msgr2=0x7f3ac80a72c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T13:49:06.481 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:06.475+0000 7f3ac67fc700 1 --2- 172.21.15.86:0/3841152633 >> v2:172.21.15.202:3300/0 conn(0x7f3ac80a6ef0 0x7f3ac80a72c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:06.481 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:06.475+0000 7f3ac67fc700 1 -- 172.21.15.86:0/3841152633 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ac80c11d0 con 0x7f3ac80c2b30 2023-03-06T13:49:06.481 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:06.475+0000 7f3ac67fc700 1 --2- 172.21.15.86:0/3841152633 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3ac80c2b30 0x7f3ac8150720 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f3ac80c2310 tx=0x7f3ab8009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2777f680cbd1ae6d server_cookie=0 in_seq=0 out_seq=0 2023-03-06T13:49:06.481 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:06.475+0000 7f3ac5ffb700 1 -- 172.21.15.86:0/3841152633 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ab800b860 con 0x7f3ac80c2b30 2023-03-06T13:49:06.481 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:06.476+0000 7f3ac5ffb700 1 -- 172.21.15.86:0/3841152633 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ab800b9c0 con 0x7f3ac80c2b30 2023-03-06T13:49:06.481 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:06.476+0000 7f3ac5ffb700 1 -- 172.21.15.86:0/3841152633 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ab800bd50 con 0x7f3ac80c2b30 2023-03-06T13:49:06.481 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:06.476+0000 7f3acd5ee700 1 -- 172.21.15.86:0/3841152633 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3ac80c2b30 msgr2=0x7f3ac8150720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:06.482 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:06.476+0000 7f3acd5ee700 1 --2- 172.21.15.86:0/3841152633 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3ac80c2b30 0x7f3ac8150720 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f3ac80c2310 tx=0x7f3ab8009c00 comp rx=0 tx=0).stop 2023-03-06T13:49:06.482 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:06.476+0000 7f3acd5ee700 1 -- 172.21.15.86:0/3841152633 shutdown_connections 2023-03-06T13:49:06.482 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:06.476+0000 7f3acd5ee700 1 --2- 172.21.15.86:0/3841152633 >> v2:172.21.15.202:3300/0 conn(0x7f3ac80a6ef0 0x7f3ac80a72c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:06.482 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:06.476+0000 7f3acd5ee700 1 --2- 172.21.15.86:0/3841152633 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f3ac80c25e0 0x7f3ac8150c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:06.482 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:06.476+0000 7f3acd5ee700 1 --2- 172.21.15.86:0/3841152633 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3ac80c2b30 0x7f3ac8150720 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:06.482 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:06.476+0000 7f3acd5ee700 1 -- 172.21.15.86:0/3841152633 >> 172.21.15.86:0/3841152633 conn(0x7f3ac8071a60 msgr2=0x7f3ac8071e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T13:49:06.482 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:06.476+0000 7f3acd5ee700 1 -- 172.21.15.86:0/3841152633 shutdown_connections 2023-03-06T13:49:06.482 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:06.476+0000 7f3acd5ee700 1 -- 172.21.15.86:0/3841152633 wait complete. 2023-03-06T13:49:06.485 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:06.477+0000 7f3acd5ee700 1 Processor -- start 2023-03-06T13:49:06.485 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:06.477+0000 7f3acd5ee700 1 -- start start 2023-03-06T13:49:06.485 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:06.478+0000 7f3acd5ee700 1 --2- >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f3ac80a6ef0 0x7f3ac81e81a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:06.485 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:06.478+0000 7f3acd5ee700 1 --2- >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f3ac80c25e0 0x7f3ac80bf130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:06.486 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:06.478+0000 7f3acd5ee700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3ac80c2b30 0x7f3ac81e5e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:06.486 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:06.478+0000 7f3acd5ee700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ac80bdfd0 con 0x7f3ac80c2b30 2023-03-06T13:49:06.486 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:06.478+0000 7f3acd5ee700 1 -- --> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ac81e7d60 con 0x7f3ac80a6ef0 2023-03-06T13:49:06.486 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:06.478+0000 7f3acd5ee700 1 -- --> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ac80bd890 con 0x7f3ac80c25e0 2023-03-06T13:49:06.487 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:06.478+0000 7f3ac77fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3ac80c2b30 0x7f3ac81e5e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:06.487 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:06.478+0000 7f3ac77fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3ac80c2b30 0x7f3ac81e5e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:38338/0 (socket says 172.21.15.86:38338) 2023-03-06T13:49:06.487 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:06.478+0000 7f3ac77fe700 1 -- 172.21.15.86:0/1221978254 learned_addr learned my addr 172.21.15.86:0/1221978254 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-03-06T13:49:06.487 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:06.478+0000 7f3ac67fc700 1 --2- 172.21.15.86:0/1221978254 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f3ac80c25e0 0x7f3ac80bf130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:06.487 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:06.478+0000 7f3ac6ffd700 1 --2- 172.21.15.86:0/1221978254 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f3ac80a6ef0 0x7f3ac81e81a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:06.487 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:06.478+0000 7f3ac77fe700 1 -- 172.21.15.86:0/1221978254 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f3ac80c25e0 msgr2=0x7f3ac80bf130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:06.488 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:06.478+0000 7f3ac77fe700 1 --2- 172.21.15.86:0/1221978254 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f3ac80c25e0 0x7f3ac80bf130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:06.488 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:06.478+0000 7f3ac77fe700 1 -- 172.21.15.86:0/1221978254 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f3ac80a6ef0 msgr2=0x7f3ac81e81a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:06.488 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:06.478+0000 7f3ac77fe700 1 --2- 172.21.15.86:0/1221978254 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f3ac80a6ef0 0x7f3ac81e81a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:06.488 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:06.478+0000 7f3ac77fe700 1 -- 172.21.15.86:0/1221978254 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ab8009550 con 0x7f3ac80c2b30 2023-03-06T13:49:06.488 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:06.478+0000 7f3ac77fe700 1 --2- 172.21.15.86:0/1221978254 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3ac80c2b30 0x7f3ac81e5e30 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f3ac0007d80 tx=0x7f3ac000e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T13:49:06.489 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:06.479+0000 7f3aaf7fe700 1 -- 172.21.15.86:0/1221978254 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ac000ed30 con 0x7f3ac80c2b30 2023-03-06T13:49:06.489 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:06.479+0000 7f3aaf7fe700 1 -- 172.21.15.86:0/1221978254 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ac000ee90 con 0x7f3ac80c2b30 2023-03-06T13:49:06.489 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:06.479+0000 7f3aaf7fe700 1 -- 172.21.15.86:0/1221978254 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ac0014660 con 0x7f3ac80c2b30 2023-03-06T13:49:06.489 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:06.479+0000 7f3acd5ee700 1 -- 172.21.15.86:0/1221978254 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ac80c1440 con 0x7f3ac80c2b30 2023-03-06T13:49:06.490 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:06.479+0000 7f3acd5ee700 1 -- 172.21.15.86:0/1221978254 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ac8150050 con 0x7f3ac80c2b30 2023-03-06T13:49:06.490 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:06.479+0000 7f3acd5ee700 1 -- 172.21.15.86:0/1221978254 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ac80c1720 con 0x7f3ac80c2b30 2023-03-06T13:49:06.490 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:06.480+0000 7f3aaf7fe700 1 -- 172.21.15.86:0/1221978254 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f3ac0012050 con 0x7f3ac80c2b30 2023-03-06T13:49:06.490 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:06.480+0000 7f3aaf7fe700 1 --2- 172.21.15.86:0/1221978254 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7f3ab40682f0 0x7f3ab406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:06.490 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:06.480+0000 7f3aaf7fe700 1 -- 172.21.15.86:0/1221978254 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f3ac0085c20 con 0x7f3ac80c2b30 2023-03-06T13:49:06.491 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:06.480+0000 7f3ac6ffd700 1 --2- 172.21.15.86:0/1221978254 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7f3ab40682f0 0x7f3ab406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:06.491 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:06.481+0000 7f3ac6ffd700 1 --2- 172.21.15.86:0/1221978254 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7f3ab40682f0 0x7f3ab406a7a0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f3abc006b20 tx=0x7f3abc008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T13:49:06.491 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:06.485+0000 7f3aaf7fe700 1 -- 172.21.15.86:0/1221978254 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f3ac0052930 con 0x7f3ac80c2b30 2023-03-06T13:49:06.669 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:06.668+0000 7f3acd5ee700 1 -- 172.21.15.86:0/1221978254 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7f3ac804e750 con 0x7f3ac80c2b30 2023-03-06T13:49:07.290 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:07.289+0000 7f3aaf7fe700 1 -- 172.21.15.86:0/1221978254 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v17) v1 ==== 109+0+0 (secure 0 0 0) 0x7f3ac0055f50 con 0x7f3ac80c2b30 2023-03-06T13:49:07.293 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:07.292+0000 7f3acd5ee700 1 -- 172.21.15.86:0/1221978254 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7f3ab40682f0 msgr2=0x7f3ab406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:07.293 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:07.292+0000 7f3acd5ee700 1 --2- 172.21.15.86:0/1221978254 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7f3ab40682f0 0x7f3ab406a7a0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f3abc006b20 tx=0x7f3abc008040 comp rx=0 tx=0).stop 2023-03-06T13:49:07.293 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:07.292+0000 7f3acd5ee700 1 -- 172.21.15.86:0/1221978254 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3ac80c2b30 msgr2=0x7f3ac81e5e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:07.293 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:07.292+0000 7f3acd5ee700 1 --2- 172.21.15.86:0/1221978254 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3ac80c2b30 0x7f3ac81e5e30 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f3ac0007d80 tx=0x7f3ac000e3c0 comp rx=0 tx=0).stop 2023-03-06T13:49:07.293 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:07.292+0000 7f3acd5ee700 1 -- 172.21.15.86:0/1221978254 shutdown_connections 2023-03-06T13:49:07.293 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:07.292+0000 7f3acd5ee700 1 --2- 172.21.15.86:0/1221978254 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7f3ab40682f0 0x7f3ab406a7a0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:07.294 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:07.292+0000 7f3acd5ee700 1 --2- 172.21.15.86:0/1221978254 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3ac80c2b30 0x7f3ac81e5e30 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:07.294 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:07.292+0000 7f3acd5ee700 1 --2- 172.21.15.86:0/1221978254 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f3ac80a6ef0 0x7f3ac81e81a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:07.294 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:07.292+0000 7f3acd5ee700 1 --2- 172.21.15.86:0/1221978254 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f3ac80c25e0 0x7f3ac80bf130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:07.294 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:07.292+0000 7f3acd5ee700 1 -- 172.21.15.86:0/1221978254 >> 172.21.15.86:0/1221978254 conn(0x7f3ac8071a60 msgr2=0x7f3ac80a4ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T13:49:07.294 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:07.292+0000 7f3acd5ee700 1 -- 172.21.15.86:0/1221978254 shutdown_connections 2023-03-06T13:49:07.294 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:07.292+0000 7f3acd5ee700 1 -- 172.21.15.86:0/1221978254 wait complete. 2023-03-06T13:49:07.295 INFO:teuthology.orchestra.run.smithi086.stderr:pool 'rbd' created 2023-03-06T13:49:07.305 DEBUG:teuthology.orchestra.run.smithi086:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2023-03-06T13:49:07.428 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:07.427+0000 7efd55394700 1 Processor -- start 2023-03-06T13:49:07.428 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:07.427+0000 7efd55394700 1 -- start start 2023-03-06T13:49:07.431 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:07.428+0000 7efd55394700 1 --2- >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7efd5006d340 0x7efd50152670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:07.431 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:07.428+0000 7efd55394700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7efd5014fd70 0x7efd50159a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:07.431 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:07.428+0000 7efd55394700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd50152bb0 con 0x7efd50149050 2023-03-06T13:49:07.431 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:07.428+0000 7efd55394700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd5006c1d0 con 0x7efd5014fd70 2023-03-06T13:49:07.431 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:07.428+0000 7efd55394700 1 -- --> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd5014f080 con 0x7efd5006d340 2023-03-06T13:49:07.431 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:07.428+0000 7efd4f7fe700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7efd5014fd70 0x7efd50159a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:07.432 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:07.428+0000 7efd4f7fe700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7efd5014fd70 0x7efd50159a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:38346/0 (socket says 172.21.15.86:38346) 2023-03-06T13:49:07.432 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:07.428+0000 7efd4f7fe700 1 -- 172.21.15.86:0/1869887814 learned_addr learned my addr 172.21.15.86:0/1869887814 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-03-06T13:49:07.432 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:07.428+0000 7efd4effd700 1 --1- 172.21.15.86:0/1869887814 >> v1:172.21.15.86:6789/0 conn(0x7efd50149050 0x7efd500c3940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:48490/0 (socket says 172.21.15.86:48490) 2023-03-06T13:49:07.432 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:07.428+0000 7efd4f7fe700 1 -- 172.21.15.86:0/1869887814 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7efd5006d340 msgr2=0x7efd50152670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T13:49:07.433 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:07.428+0000 7efd4f7fe700 1 --2- 172.21.15.86:0/1869887814 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7efd5006d340 0x7efd50152670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:07.433 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:07.428+0000 7efd4f7fe700 1 -- 172.21.15.86:0/1869887814 >> v1:172.21.15.86:6789/0 conn(0x7efd50149050 legacy=0x7efd500c3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:07.433 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:07.428+0000 7efd4dffb700 1 -- 172.21.15.86:0/1869887814 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3403504337 0 0) 0x7efd50152bb0 con 0x7efd50149050 2023-03-06T13:49:07.433 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:07.428+0000 7efd4f7fe700 1 -- 172.21.15.86:0/1869887814 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd5006f710 con 0x7efd5014fd70 2023-03-06T13:49:07.433 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:07.429+0000 7efd4f7fe700 1 --2- 172.21.15.86:0/1869887814 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efd5014fd70 0x7efd50159a00 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7efd48009e50 tx=0x7efd4800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26216c6ca0258746 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T13:49:07.433 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:07.429+0000 7efd4dffb700 1 -- 172.21.15.86:0/1869887814 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd4800e070 con 0x7efd5014fd70 2023-03-06T13:49:07.434 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:07.429+0000 7efd4dffb700 1 -- 172.21.15.86:0/1869887814 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd4800b9c0 con 0x7efd5014fd70 2023-03-06T13:49:07.434 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:07.429+0000 7efd4dffb700 1 -- 172.21.15.86:0/1869887814 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd4800bd70 con 0x7efd5014fd70 2023-03-06T13:49:07.434 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:07.429+0000 7efd55394700 1 -- 172.21.15.86:0/1869887814 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efd5014fd70 msgr2=0x7efd50159a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:07.434 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:07.429+0000 7efd55394700 1 --2- 172.21.15.86:0/1869887814 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efd5014fd70 0x7efd50159a00 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7efd48009e50 tx=0x7efd4800b330 comp rx=0 tx=0).stop 2023-03-06T13:49:07.434 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:07.429+0000 7efd55394700 1 -- 172.21.15.86:0/1869887814 shutdown_connections 2023-03-06T13:49:07.434 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:07.429+0000 7efd55394700 1 --2- 172.21.15.86:0/1869887814 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efd5014fd70 0x7efd50159a00 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:07.434 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:07.429+0000 7efd55394700 1 --2- 172.21.15.86:0/1869887814 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7efd5006d340 0x7efd50152670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:07.435 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:07.429+0000 7efd55394700 1 -- 172.21.15.86:0/1869887814 >> 172.21.15.86:0/1869887814 conn(0x7efd5006afc0 msgr2=0x7efd500c3230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T13:49:07.435 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:07.429+0000 7efd55394700 1 -- 172.21.15.86:0/1869887814 shutdown_connections 2023-03-06T13:49:07.435 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:07.429+0000 7efd55394700 1 -- 172.21.15.86:0/1869887814 wait complete. 2023-03-06T13:49:07.438 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:07.431+0000 7efd55394700 1 Processor -- start 2023-03-06T13:49:07.438 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:07.431+0000 7efd55394700 1 -- start start 2023-03-06T13:49:07.438 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:07.431+0000 7efd55394700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efd5006d340 0x7efd500a7550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:07.438 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:07.431+0000 7efd55394700 1 --2- >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7efd50149050 0x7efd501e7d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:07.438 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:07.431+0000 7efd55394700 1 --2- >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7efd5014fd70 0x7efd501de530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:07.439 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:07.431+0000 7efd55394700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd500a8160 con 0x7efd5006d340 2023-03-06T13:49:07.439 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:07.431+0000 7efd55394700 1 -- --> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd500a6670 con 0x7efd5014fd70 2023-03-06T13:49:07.439 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:07.431+0000 7efd55394700 1 -- --> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd500a6390 con 0x7efd50149050 2023-03-06T13:49:07.439 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:07.431+0000 7efd4effd700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efd5006d340 0x7efd500a7550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:07.439 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:07.431+0000 7efd4effd700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efd5006d340 0x7efd500a7550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:38348/0 (socket says 172.21.15.86:38348) 2023-03-06T13:49:07.439 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:07.431+0000 7efd4effd700 1 -- 172.21.15.86:0/1406227533 learned_addr learned my addr 172.21.15.86:0/1406227533 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-03-06T13:49:07.439 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:07.432+0000 7efd4f7fe700 1 --2- 172.21.15.86:0/1406227533 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7efd5014fd70 0x7efd501de530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:07.440 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:07.432+0000 7efd4e7fc700 1 --2- 172.21.15.86:0/1406227533 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7efd50149050 0x7efd501e7d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:07.440 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:07.432+0000 7efd4effd700 1 -- 172.21.15.86:0/1406227533 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7efd50149050 msgr2=0x7efd501e7d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:07.440 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:07.432+0000 7efd4effd700 1 --2- 172.21.15.86:0/1406227533 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7efd50149050 0x7efd501e7d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:07.440 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:07.432+0000 7efd4effd700 1 -- 172.21.15.86:0/1406227533 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7efd5014fd70 msgr2=0x7efd501de530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:07.440 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:07.432+0000 7efd4effd700 1 --2- 172.21.15.86:0/1406227533 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7efd5014fd70 0x7efd501de530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:07.440 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:07.432+0000 7efd4effd700 1 -- 172.21.15.86:0/1406227533 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd48009b30 con 0x7efd5006d340 2023-03-06T13:49:07.441 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:07.432+0000 7efd4f7fe700 1 --2- 172.21.15.86:0/1406227533 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7efd5014fd70 0x7efd501de530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-06T13:49:07.441 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:07.432+0000 7efd4effd700 1 --2- 172.21.15.86:0/1406227533 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efd5006d340 0x7efd500a7550 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7efd440011e0 tx=0x7efd4400cae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T13:49:07.441 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:07.432+0000 7efd377fe700 1 -- 172.21.15.86:0/1406227533 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd44004c80 con 0x7efd5006d340 2023-03-06T13:49:07.441 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:07.432+0000 7efd377fe700 1 -- 172.21.15.86:0/1406227533 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd44004e00 con 0x7efd5006d340 2023-03-06T13:49:07.441 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:07.432+0000 7efd55394700 1 -- 172.21.15.86:0/1406227533 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd5006fee0 con 0x7efd5006d340 2023-03-06T13:49:07.441 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:07.432+0000 7efd377fe700 1 -- 172.21.15.86:0/1406227533 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd44007310 con 0x7efd5006d340 2023-03-06T13:49:07.441 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:07.432+0000 7efd55394700 1 -- 172.21.15.86:0/1406227533 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd5006c440 con 0x7efd5006d340 2023-03-06T13:49:07.442 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:07.433+0000 7efd55394700 1 -- 172.21.15.86:0/1406227533 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd5014f290 con 0x7efd5006d340 2023-03-06T13:49:07.442 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:07.433+0000 7efd377fe700 1 -- 172.21.15.86:0/1406227533 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7efd4401a020 con 0x7efd5006d340 2023-03-06T13:49:07.442 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:07.434+0000 7efd377fe700 1 --2- 172.21.15.86:0/1406227533 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7efd3c0682f0 0x7efd3c06a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:07.442 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:07.434+0000 7efd377fe700 1 -- 172.21.15.86:0/1406227533 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5199+0+0 (secure 0 0 0) 0x7efd440855b0 con 0x7efd5006d340 2023-03-06T13:49:07.442 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:07.434+0000 7efd4e7fc700 1 --2- 172.21.15.86:0/1406227533 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7efd3c0682f0 0x7efd3c06a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:07.442 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:07.434+0000 7efd4e7fc700 1 --2- 172.21.15.86:0/1406227533 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7efd3c0682f0 0x7efd3c06a7a0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7efd501e22e0 tx=0x7efd40008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T13:49:07.443 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:07.438+0000 7efd377fe700 1 -- 172.21.15.86:0/1406227533 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7efd44052170 con 0x7efd5006d340 2023-03-06T13:49:07.624 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:07.624+0000 7efd55394700 1 -- 172.21.15.86:0/1406227533 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) v1 -- 0x7efd5004e7c0 con 0x7efd5006d340 2023-03-06T13:49:08.300 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:08.298+0000 7efd377fe700 1 -- 172.21.15.86:0/1406227533 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v18) v1 ==== 173+0+0 (secure 0 0 0) 0x7efd44055790 con 0x7efd5006d340 2023-03-06T13:49:08.302 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:08.301+0000 7efd55394700 1 -- 172.21.15.86:0/1406227533 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7efd3c0682f0 msgr2=0x7efd3c06a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:08.303 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:08.301+0000 7efd55394700 1 --2- 172.21.15.86:0/1406227533 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7efd3c0682f0 0x7efd3c06a7a0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7efd501e22e0 tx=0x7efd40008040 comp rx=0 tx=0).stop 2023-03-06T13:49:08.303 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:08.301+0000 7efd55394700 1 -- 172.21.15.86:0/1406227533 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efd5006d340 msgr2=0x7efd500a7550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:08.303 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:08.301+0000 7efd55394700 1 --2- 172.21.15.86:0/1406227533 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efd5006d340 0x7efd500a7550 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7efd440011e0 tx=0x7efd4400cae0 comp rx=0 tx=0).stop 2023-03-06T13:49:08.303 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:08.301+0000 7efd55394700 1 -- 172.21.15.86:0/1406227533 shutdown_connections 2023-03-06T13:49:08.303 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:08.301+0000 7efd55394700 1 --2- 172.21.15.86:0/1406227533 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7efd3c0682f0 0x7efd3c06a7a0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:08.303 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:08.301+0000 7efd55394700 1 --2- 172.21.15.86:0/1406227533 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efd5006d340 0x7efd500a7550 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:08.303 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:08.301+0000 7efd55394700 1 --2- 172.21.15.86:0/1406227533 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7efd5014fd70 0x7efd501de530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:08.304 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:08.301+0000 7efd55394700 1 --2- 172.21.15.86:0/1406227533 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7efd50149050 0x7efd501e7d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:08.304 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:08.301+0000 7efd55394700 1 -- 172.21.15.86:0/1406227533 >> 172.21.15.86:0/1406227533 conn(0x7efd5006afc0 msgr2=0x7efd50146b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T13:49:08.304 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:08.301+0000 7efd55394700 1 -- 172.21.15.86:0/1406227533 shutdown_connections 2023-03-06T13:49:08.304 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:08.301+0000 7efd55394700 1 -- 172.21.15.86:0/1406227533 wait complete. 2023-03-06T13:49:08.304 INFO:teuthology.orchestra.run.smithi086.stderr:enabled application 'rbd' on pool 'rbd' 2023-03-06T13:49:08.318 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-03-06T13:49:08.318 INFO:tasks.ceph.mds.a:Restarting daemon 2023-03-06T13:49:08.319 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-03-06T13:49:08.321 INFO:tasks.ceph.mds.a:Started 2023-03-06T13:49:08.321 INFO:tasks.ceph.mds.c:Restarting daemon 2023-03-06T13:49:08.321 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-03-06T13:49:08.323 INFO:tasks.ceph.mds.c:Started 2023-03-06T13:49:08.323 INFO:tasks.ceph.mds.b:Restarting daemon 2023-03-06T13:49:08.324 DEBUG:teuthology.orchestra.run.smithi202:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-03-06T13:49:08.326 INFO:tasks.ceph.mds.b:Started 2023-03-06T13:49:08.326 INFO:tasks.ceph.mds.d:Restarting daemon 2023-03-06T13:49:08.326 DEBUG:teuthology.orchestra.run.smithi202:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-03-06T13:49:08.328 INFO:tasks.ceph.mds.d:Started 2023-03-06T13:49:08.329 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-03-06T13:49:08.329 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-03-06T13:49:08.405 INFO:tasks.ceph.mds.a.smithi086.stdout:starting mds.a at 2023-03-06T13:49:08.406 INFO:tasks.ceph.mds.c.smithi086.stdout:starting mds.c at 2023-03-06T13:49:08.413 INFO:tasks.ceph.mds.b.smithi202.stdout:starting mds.b at 2023-03-06T13:49:08.413 INFO:tasks.ceph.mds.d.smithi202.stdout:starting mds.d at 2023-03-06T13:49:08.464 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:08.463+0000 7f34143ec700 1 Processor -- start 2023-03-06T13:49:08.464 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:08.463+0000 7f34143ec700 1 -- start start 2023-03-06T13:49:08.466 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:08.464+0000 7f34143ec700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f340c0c3940 0x7f340c0c3d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:08.466 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:08.464+0000 7f34143ec700 1 --2- >> v2:172.21.15.202:3300/0 conn(0x7f340c150c30 0x7f340c1578b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:08.467 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:08.465+0000 7f34143ec700 1 -- --> v1:172.21.15.202:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f340c0b9240 con 0x7f340c06fbb0 2023-03-06T13:49:08.467 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:08.465+0000 7f34143ec700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f340c0b8580 con 0x7f340c0c3940 2023-03-06T13:49:08.467 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:08.465+0000 7f34143ec700 1 -- --> v2:172.21.15.202:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f340c06f730 con 0x7f340c150c30 2023-03-06T13:49:08.467 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:08.465+0000 7f3412188700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f340c0c3940 0x7f340c0c3d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:08.467 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:08.465+0000 7f3412188700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f340c0c3940 0x7f340c0c3d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:38380/0 (socket says 172.21.15.86:38380) 2023-03-06T13:49:08.467 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:08.465+0000 7f3412188700 1 -- 172.21.15.86:0/3335795224 learned_addr learned my addr 172.21.15.86:0/3335795224 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-03-06T13:49:08.467 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:08.465+0000 7f3412188700 1 -- 172.21.15.86:0/3335795224 >> v2:172.21.15.202:3300/0 conn(0x7f340c150c30 msgr2=0x7f340c1578b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T13:49:08.468 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:08.465+0000 7f3412989700 1 --2- 172.21.15.86:0/3335795224 >> v2:172.21.15.202:3300/0 conn(0x7f340c150c30 0x7f340c1578b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:08.468 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:08.465+0000 7f3412188700 1 --2- 172.21.15.86:0/3335795224 >> v2:172.21.15.202:3300/0 conn(0x7f340c150c30 0x7f340c1578b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:08.468 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:08.465+0000 7f3412188700 1 -- 172.21.15.86:0/3335795224 >> v1:172.21.15.202:6789/0 conn(0x7f340c06fbb0 legacy=0x7f340c150520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T13:49:08.468 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:08.465+0000 7f3412188700 1 -- 172.21.15.86:0/3335795224 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f340c14deb0 con 0x7f340c0c3940 2023-03-06T13:49:08.468 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:08.465+0000 7f3412188700 1 --2- 172.21.15.86:0/3335795224 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f340c0c3940 0x7f340c0c3d10 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f340c06efb0 tx=0x7f340400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1dde90538665234 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T13:49:08.468 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:08.465+0000 7f3411186700 1 -- 172.21.15.86:0/3335795224 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f340400e070 con 0x7f340c0c3940 2023-03-06T13:49:08.468 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:08.465+0000 7f3411186700 1 -- 172.21.15.86:0/3335795224 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3404003a20 con 0x7f340c0c3940 2023-03-06T13:49:08.468 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:08.465+0000 7f3411186700 1 -- 172.21.15.86:0/3335795224 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3404003dd0 con 0x7f340c0c3940 2023-03-06T13:49:08.471 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:08.466+0000 7f34143ec700 1 -- 172.21.15.86:0/3335795224 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f340c0c3940 msgr2=0x7f340c0c3d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:08.471 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:08.466+0000 7f34143ec700 1 --2- 172.21.15.86:0/3335795224 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f340c0c3940 0x7f340c0c3d10 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f340c06efb0 tx=0x7f340400b330 comp rx=0 tx=0).stop 2023-03-06T13:49:08.471 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:08.466+0000 7f34143ec700 1 -- 172.21.15.86:0/3335795224 shutdown_connections 2023-03-06T13:49:08.471 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:08.466+0000 7f34143ec700 1 --2- 172.21.15.86:0/3335795224 >> v2:172.21.15.202:3300/0 conn(0x7f340c150c30 0x7f340c1578b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:08.471 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:08.466+0000 7f34143ec700 1 --2- 172.21.15.86:0/3335795224 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f340c0c3940 0x7f340c0c3d10 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:08.471 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:08.466+0000 7f34143ec700 1 -- 172.21.15.86:0/3335795224 >> 172.21.15.86:0/3335795224 conn(0x7f340c06af80 msgr2=0x7f340c0c3230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T13:49:08.472 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:08.466+0000 7f34143ec700 1 -- 172.21.15.86:0/3335795224 shutdown_connections 2023-03-06T13:49:08.472 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:08.466+0000 7f34143ec700 1 -- 172.21.15.86:0/3335795224 wait complete. 2023-03-06T13:49:08.472 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:08.467+0000 7f34143ec700 1 Processor -- start 2023-03-06T13:49:08.472 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:08.467+0000 7f34143ec700 1 -- start start 2023-03-06T13:49:08.472 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:08.468+0000 7f34143ec700 1 --2- >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f340c06fbb0 0x7f340c0a81e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:08.472 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:08.468+0000 7f34143ec700 1 --2- >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f340c0c3940 0x7f340c0a6600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:08.472 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:08.468+0000 7f34143ec700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f340c150c30 0x7f340c147b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:08.473 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:08.468+0000 7f34143ec700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f340c0a8720 con 0x7f340c150c30 2023-03-06T13:49:08.473 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:08.468+0000 7f34143ec700 1 -- --> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f340c0a6b40 con 0x7f340c06fbb0 2023-03-06T13:49:08.473 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:08.468+0000 7f34143ec700 1 -- --> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f340c0a7a20 con 0x7f340c0c3940 2023-03-06T13:49:08.473 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:08.468+0000 7f3412989700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f340c150c30 0x7f340c147b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:08.473 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:08.468+0000 7f3412188700 1 --2- >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f340c06fbb0 0x7f340c0a81e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:08.473 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:08.468+0000 7f3412989700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f340c150c30 0x7f340c147b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:38390/0 (socket says 172.21.15.86:38390) 2023-03-06T13:49:08.473 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:08.468+0000 7f3412989700 1 -- 172.21.15.86:0/920623075 learned_addr learned my addr 172.21.15.86:0/920623075 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-03-06T13:49:08.474 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:08.468+0000 7f3411987700 1 --2- 172.21.15.86:0/920623075 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f340c0c3940 0x7f340c0a6600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:08.474 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:08.469+0000 7f3412989700 1 -- 172.21.15.86:0/920623075 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f340c0c3940 msgr2=0x7f340c0a6600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:08.474 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:08.469+0000 7f3412989700 1 --2- 172.21.15.86:0/920623075 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f340c0c3940 0x7f340c0a6600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:08.474 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:08.469+0000 7f3412989700 1 -- 172.21.15.86:0/920623075 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f340c06fbb0 msgr2=0x7f340c0a81e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:08.474 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:08.469+0000 7f3412989700 1 --2- 172.21.15.86:0/920623075 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f340c06fbb0 0x7f340c0a81e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:08.474 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:08.469+0000 7f3412989700 1 -- 172.21.15.86:0/920623075 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3404009b30 con 0x7f340c150c30 2023-03-06T13:49:08.474 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:08.469+0000 7f3412989700 1 --2- 172.21.15.86:0/920623075 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f340c150c30 0x7f340c147b10 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f340800c820 tx=0x7f340800cb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T13:49:08.475 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:08.469+0000 7f3402ffd700 1 -- 172.21.15.86:0/920623075 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3408004220 con 0x7f340c150c30 2023-03-06T13:49:08.475 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:08.469+0000 7f3402ffd700 1 -- 172.21.15.86:0/920623075 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34080043a0 con 0x7f340c150c30 2023-03-06T13:49:08.475 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:08.469+0000 7f34143ec700 1 -- 172.21.15.86:0/920623075 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f340c0b9790 con 0x7f340c150c30 2023-03-06T13:49:08.475 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:08.469+0000 7f3402ffd700 1 -- 172.21.15.86:0/920623075 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34080038e0 con 0x7f340c150c30 2023-03-06T13:49:08.475 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:08.469+0000 7f34143ec700 1 -- 172.21.15.86:0/920623075 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f340c1475f0 con 0x7f340c150c30 2023-03-06T13:49:08.475 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:08.470+0000 7f34143ec700 1 -- 172.21.15.86:0/920623075 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f340c0b9a70 con 0x7f340c150c30 2023-03-06T13:49:08.476 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:08.470+0000 7f3402ffd700 1 -- 172.21.15.86:0/920623075 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f3408020070 con 0x7f340c150c30 2023-03-06T13:49:08.476 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:08.471+0000 7f3402ffd700 1 --2- 172.21.15.86:0/920623075 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7f33f00682f0 0x7f33f006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:08.477 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:08.471+0000 7f3402ffd700 1 -- 172.21.15.86:0/920623075 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f3408085210 con 0x7f340c150c30 2023-03-06T13:49:08.477 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:08.471+0000 7f3412188700 1 --2- 172.21.15.86:0/920623075 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7f33f00682f0 0x7f33f006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:08.477 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:08.471+0000 7f3412188700 1 --2- 172.21.15.86:0/920623075 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7f33f00682f0 0x7f33f006a7a0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f3404000f80 tx=0x7f3404009000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T13:49:08.477 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:08.475+0000 7f3402ffd700 1 -- 172.21.15.86:0/920623075 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f3408051dc0 con 0x7f340c150c30 2023-03-06T13:49:08.662 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:08.661+0000 7f34143ec700 1 -- 172.21.15.86:0/920623075 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f340c04e750 con 0x7f340c150c30 2023-03-06T13:49:08.662 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:08.662+0000 7f3402ffd700 1 -- 172.21.15.86:0/920623075 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) v1 ==== 74+0+14181 (secure 0 0 0) 0x7f34080553e0 con 0x7f340c150c30 2023-03-06T13:49:08.663 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-03-06T13:49:08.663 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":18,"fsid":"2cca6c77-50cb-47d8-a8c7-444575d01327","created":"2023-03-06T13:48:48.337369+0000","modified":"2023-03-06T13:49:08.285226+0000","last_up_change":"2023-03-06T13:48:59.782729+0000","last_in_change":"2023-03-06T13:48:50.777249+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-03-06T13:48:59.879087+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-03-06T13:49:06.686394+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2de68e69-e10f-49e1-a15a-8a9bfff504c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":96739},{"type":"v1","addr":"172.21.15.86:6816","nonce":96739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":96739},{"type":"v1","addr":"172.21.15.86:6819","nonce":96739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":96739},{"type":"v1","addr":"172.21.15.86:6823","nonce":96739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":96739},{"type":"v1","addr":"172.21.15.86:6821","nonce":96739}]},"public_addr":"172.21.15.86:6816/96739","cluster_addr":"172.21.15.86:6819/96739","heartbeat_back_addr":"172.21.15.86:6823/96739","heartbeat_front_addr":"172.21.15.86:6821/96739","state":["exists","up"]},{"osd":1,"uuid":"3e75c061-0de5-4742-a20d-4b5a4adb9b81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":96738},{"type":"v1","addr":"172.21.15.86:6801","nonce":96738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":96738},{"type":"v1","addr":"172.21.15.86:6803","nonce":96738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":96738},{"type":"v1","addr":"172.21.15.86:6807","nonce":96738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":96738},{"type":"v1","addr":"172.21.15.86:6805","nonce":96738}]},"public_addr":"172.21.15.86:6801/96738","cluster_addr":"172.21.15.86:6803/96738","heartbeat_back_addr":"172.21.15.86:6807/96738","heartbeat_front_addr":"172.21.15.86:6805/96738","state":["exists","up"]},{"osd":2,"uuid":"38d71bce-81c2-4e33-91e1-65efb08f2291","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":96740},{"type":"v1","addr":"172.21.15.86:6809","nonce":96740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":96740},{"type":"v1","addr":"172.21.15.86:6811","nonce":96740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6815","nonce":96740},{"type":"v1","addr":"172.21.15.86:6817","nonce":96740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":96740},{"type":"v1","addr":"172.21.15.86:6813","nonce":96740}]},"public_addr":"172.21.15.86:6809/96740","cluster_addr":"172.21.15.86:6811/96740","heartbeat_back_addr":"172.21.15.86:6817/96740","heartbeat_front_addr":"172.21.15.86:6813/96740","state":["exists","up"]},{"osd":3,"uuid":"d95a2686-21bd-4b66-9ea5-eef65403935b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":96756},{"type":"v1","addr":"172.21.15.86:6825","nonce":96756}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":96756},{"type":"v1","addr":"172.21.15.86:6827","nonce":96756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":96756},{"type":"v1","addr":"172.21.15.86:6831","nonce":96756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":96756},{"type":"v1","addr":"172.21.15.86:6829","nonce":96756}]},"public_addr":"172.21.15.86:6825/96756","cluster_addr":"172.21.15.86:6827/96756","heartbeat_back_addr":"172.21.15.86:6831/96756","heartbeat_front_addr":"172.21.15.86:6829/96756","state":["exists","up"]},{"osd":4,"uuid":"98c7e359-0f00-496a-8aaa-5472af355e48","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.202:6816","nonce":96847},{"type":"v1","addr":"172.21.15.202:6817","nonce":96847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.202:6818","nonce":96847},{"type":"v1","addr":"172.21.15.202:6819","nonce":96847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.202:6822","nonce":96847},{"type":"v1","addr":"172.21.15.202:6823","nonce":96847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.202:6820","nonce":96847},{"type":"v1","addr":"172.21.15.202:6821","nonce":96847}]},"public_addr":"172.21.15.202:6817/96847","cluster_addr":"172.21.15.202:6819/96847","heartbeat_back_addr":"172.21.15.202:6823/96847","heartbeat_front_addr":"172.21.15.202:6821/96847","state":["exists","up"]},{"osd":5,"uuid":"fa6688d9-73f3-4593-a50e-d96a0fe5f4cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.202:6824","nonce":96848},{"type":"v1","addr":"172.21.15.202:6825","nonce":96848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.202:6826","nonce":96848},{"type":"v1","addr":"172.21.15.202:6827","nonce":96848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.202:6830","nonce":96848},{"type":"v1","addr":"172.21.15.202:6831","nonce":96848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.202:6828","nonce":96848},{"type":"v1","addr":"172.21.15.202:6829","nonce":96848}]},"public_addr":"172.21.15.202:6825/96848","cluster_addr":"172.21.15.202:6827/96848","heartbeat_back_addr":"172.21.15.202:6831/96848","heartbeat_front_addr":"172.21.15.202:6829/96848","state":["exists","up"]},{"osd":6,"uuid":"7bfc6dc0-2388-4498-9cd7-766e3606f6a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.202:6808","nonce":96845},{"type":"v1","addr":"172.21.15.202:6809","nonce":96845}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.202:6810","nonce":96845},{"type":"v1","addr":"172.21.15.202:6811","nonce":96845}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.202:6814","nonce":96845},{"type":"v1","addr":"172.21.15.202:6815","nonce":96845}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.202:6812","nonce":96845},{"type":"v1","addr":"172.21.15.202:6813","nonce":96845}]},"public_addr":"172.21.15.202:6809/96845","cluster_addr":"172.21.15.202:6811/96845","heartbeat_back_addr":"172.21.15.202:6815/96845","heartbeat_front_addr":"172.21.15.202:6813/96845","state":["exists","up"]},{"osd":7,"uuid":"c475f863-96fd-48e3-8033-7d1c3b1d503f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.202:6800","nonce":96846},{"type":"v1","addr":"172.21.15.202:6801","nonce":96846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.202:6802","nonce":96846},{"type":"v1","addr":"172.21.15.202:6803","nonce":96846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.202:6806","nonce":96846},{"type":"v1","addr":"172.21.15.202:6807","nonce":96846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.202:6804","nonce":96846},{"type":"v1","addr":"172.21.15.202:6805","nonce":96846}]},"public_addr":"172.21.15.202:6801/96846","cluster_addr":"172.21.15.202:6803/96846","heartbeat_back_addr":"172.21.15.202:6807/96846","heartbeat_front_addr":"172.21.15.202:6805/96846","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-06T13:48:55.997991+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-06T13:48:55.930805+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-06T13:48:56.000312+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-06T13:48:55.998360+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-06T13:48:56.052762+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-06T13:48:56.036049+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-06T13:48:56.048751+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-06T13:48:56.011928+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-03-06T13:49:08.665 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:08.664+0000 7f34143ec700 1 -- 172.21.15.86:0/920623075 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7f33f00682f0 msgr2=0x7f33f006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:08.665 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:08.664+0000 7f34143ec700 1 --2- 172.21.15.86:0/920623075 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7f33f00682f0 0x7f33f006a7a0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f3404000f80 tx=0x7f3404009000 comp rx=0 tx=0).stop 2023-03-06T13:49:08.665 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:08.664+0000 7f34143ec700 1 -- 172.21.15.86:0/920623075 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f340c150c30 msgr2=0x7f340c147b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:08.665 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:08.664+0000 7f34143ec700 1 --2- 172.21.15.86:0/920623075 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f340c150c30 0x7f340c147b10 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f340800c820 tx=0x7f340800cb30 comp rx=0 tx=0).stop 2023-03-06T13:49:08.665 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:08.664+0000 7f34143ec700 1 -- 172.21.15.86:0/920623075 shutdown_connections 2023-03-06T13:49:08.665 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:08.664+0000 7f34143ec700 1 --2- 172.21.15.86:0/920623075 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7f33f00682f0 0x7f33f006a7a0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:08.666 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:08.664+0000 7f34143ec700 1 --2- 172.21.15.86:0/920623075 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f340c150c30 0x7f340c147b10 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:08.666 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:08.664+0000 7f34143ec700 1 --2- 172.21.15.86:0/920623075 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f340c06fbb0 0x7f340c0a81e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:08.666 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:08.664+0000 7f34143ec700 1 --2- 172.21.15.86:0/920623075 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f340c0c3940 0x7f340c0a6600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:08.666 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:08.664+0000 7f34143ec700 1 -- 172.21.15.86:0/920623075 >> 172.21.15.86:0/920623075 conn(0x7f340c06af80 msgr2=0x7f340c14ada0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T13:49:08.666 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:08.664+0000 7f34143ec700 1 -- 172.21.15.86:0/920623075 shutdown_connections 2023-03-06T13:49:08.666 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:08.664+0000 7f34143ec700 1 -- 172.21.15.86:0/920623075 wait complete. 2023-03-06T13:49:08.677 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-03-06T13:48:59.879087+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-03-06T13:49:06.686394+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-03-06T13:49:08.677 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-03-06T13:49:08.808 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:08.800+0000 7fb7427b4700 1 Processor -- start 2023-03-06T13:49:08.809 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:08.800+0000 7fb7427b4700 1 -- start start 2023-03-06T13:49:08.809 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:08.801+0000 7fb7427b4700 1 --2- >> v2:172.21.15.202:3300/0 conn(0x7fb73c149420 0x7fb73c0c2860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:08.809 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:08.801+0000 7fb7427b4700 1 --2- >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fb73c0c2da0 0x7fb73c14f0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:08.809 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:08.801+0000 7fb7427b4700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb73c153340 con 0x7fb73c06ea90 2023-03-06T13:49:08.809 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:08.801+0000 7fb7427b4700 1 -- --> v2:172.21.15.202:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb73c1497f0 con 0x7fb73c149420 2023-03-06T13:49:08.809 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:08.801+0000 7fb7427b4700 1 -- --> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb73c152750 con 0x7fb73c0c2da0 2023-03-06T13:49:08.809 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:08.801+0000 7fb740d51700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7fb73c06ea90 0x7fb73c06a330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:48544/0 (socket says 172.21.15.86:48544) 2023-03-06T13:49:08.810 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:08.801+0000 7fb740d51700 1 -- 172.21.15.86:0/2521599176 learned_addr learned my addr 172.21.15.86:0/2521599176 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-03-06T13:49:08.810 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:08.801+0000 7fb73b7fe700 1 --2- 172.21.15.86:0/2521599176 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fb73c0c2da0 0x7fb73c14f0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:08.810 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:08.801+0000 7fb73bfff700 1 --2- 172.21.15.86:0/2521599176 >> v2:172.21.15.202:3300/0 conn(0x7fb73c149420 0x7fb73c0c2860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:08.811 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:08.801+0000 7fb73affd700 1 -- 172.21.15.86:0/2521599176 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2165153417 0 0) 0x7fb73c153340 con 0x7fb73c06ea90 2023-03-06T13:49:08.811 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:08.801+0000 7fb73affd700 1 -- 172.21.15.86:0/2521599176 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb7240035b0 con 0x7fb73c06ea90 2023-03-06T13:49:08.811 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:08.801+0000 7fb73affd700 1 -- 172.21.15.86:0/2521599176 <== mon.0 v1:172.21.15.86:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1890015605 0 0) 0x7fb7240035b0 con 0x7fb73c06ea90 2023-03-06T13:49:08.811 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:08.801+0000 7fb73affd700 1 -- 172.21.15.86:0/2521599176 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fb73c0c2da0 msgr2=0x7fb73c14f0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T13:49:08.811 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:08.801+0000 7fb73affd700 1 --2- 172.21.15.86:0/2521599176 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fb73c0c2da0 0x7fb73c14f0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:08.811 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:08.801+0000 7fb73affd700 1 -- 172.21.15.86:0/2521599176 >> v2:172.21.15.202:3300/0 conn(0x7fb73c149420 msgr2=0x7fb73c0c2860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T13:49:08.812 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:08.801+0000 7fb73affd700 1 --2- 172.21.15.86:0/2521599176 >> v2:172.21.15.202:3300/0 conn(0x7fb73c149420 0x7fb73c0c2860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:08.812 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:08.801+0000 7fb73affd700 1 -- 172.21.15.86:0/2521599176 --> v1:172.21.15.86:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb73c152a10 con 0x7fb73c06ea90 2023-03-06T13:49:08.812 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:08.801+0000 7fb73affd700 1 -- 172.21.15.86:0/2521599176 <== mon.0 v1:172.21.15.86:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2191261126 0 0) 0x7fb7340019f0 con 0x7fb73c06ea90 2023-03-06T13:49:08.812 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:08.801+0000 7fb73b7fe700 1 --2- 172.21.15.86:0/2521599176 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fb73c0c2da0 0x7fb73c14f0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-06T13:49:08.812 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:08.802+0000 7fb73affd700 1 -- 172.21.15.86:0/2521599176 >> v1:172.21.15.86:6789/0 conn(0x7fb73c06ea90 legacy=0x7fb73c06a330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:08.812 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:08.802+0000 7fb73affd700 1 --2- 172.21.15.86:0/2521599176 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7fb724003a00 0x7fb724003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:08.812 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:08.802+0000 7fb73affd700 1 --2- 172.21.15.86:0/2521599176 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fb73c0c2da0 0x7fb724004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:08.813 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:08.802+0000 7fb73affd700 1 --2- 172.21.15.86:0/2521599176 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb724004d90 0x7fb724005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:08.813 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:08.802+0000 7fb73affd700 1 -- 172.21.15.86:0/2521599176 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb73c1497f0 con 0x7fb724004d90 2023-03-06T13:49:08.813 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:08.802+0000 7fb73affd700 1 -- 172.21.15.86:0/2521599176 --> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb73c152750 con 0x7fb724003a00 2023-03-06T13:49:08.813 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:08.802+0000 7fb73affd700 1 -- 172.21.15.86:0/2521599176 --> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb72400ba10 con 0x7fb73c0c2da0 2023-03-06T13:49:08.813 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:08.802+0000 7fb740d51700 1 --2- 172.21.15.86:0/2521599176 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb724004d90 0x7fb724005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:08.813 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:08.802+0000 7fb73bfff700 1 --2- 172.21.15.86:0/2521599176 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7fb724003a00 0x7fb724003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:08.813 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:08.802+0000 7fb73b7fe700 1 --2- 172.21.15.86:0/2521599176 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fb73c0c2da0 0x7fb724004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:08.814 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:08.802+0000 7fb740d51700 1 -- 172.21.15.86:0/2521599176 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fb73c0c2da0 msgr2=0x7fb724004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T13:49:08.814 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:08.802+0000 7fb740d51700 1 --2- 172.21.15.86:0/2521599176 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fb73c0c2da0 0x7fb724004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:08.814 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:08.802+0000 7fb740d51700 1 -- 172.21.15.86:0/2521599176 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7fb724003a00 msgr2=0x7fb724003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T13:49:08.814 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:08.802+0000 7fb740d51700 1 --2- 172.21.15.86:0/2521599176 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7fb724003a00 0x7fb724003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:08.814 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:08.802+0000 7fb740d51700 1 -- 172.21.15.86:0/2521599176 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb72c0094a0 con 0x7fb724004d90 2023-03-06T13:49:08.814 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:08.802+0000 7fb740d51700 1 --2- 172.21.15.86:0/2521599176 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb724004d90 0x7fb724005200 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fb73400a860 tx=0x7fb724005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78f7f29a58d2f47d server_cookie=0 in_seq=0 out_seq=0 2023-03-06T13:49:08.814 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:08.802+0000 7fb73affd700 1 -- 172.21.15.86:0/2521599176 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb734012600 con 0x7fb724004d90 2023-03-06T13:49:08.814 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:08.802+0000 7fb73affd700 1 -- 172.21.15.86:0/2521599176 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb734012780 con 0x7fb724004d90 2023-03-06T13:49:08.815 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:08.802+0000 7fb73affd700 1 -- 172.21.15.86:0/2521599176 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb734012b30 con 0x7fb724004d90 2023-03-06T13:49:08.815 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:08.803+0000 7fb7427b4700 1 -- 172.21.15.86:0/2521599176 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb724004d90 msgr2=0x7fb724005200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:08.815 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:08.803+0000 7fb7427b4700 1 --2- 172.21.15.86:0/2521599176 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb724004d90 0x7fb724005200 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fb73400a860 tx=0x7fb724005880 comp rx=0 tx=0).stop 2023-03-06T13:49:08.815 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:08.803+0000 7fb740d51700 1 -- 172.21.15.86:0/2521599176 reap_dead start 2023-03-06T13:49:08.815 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:08.803+0000 7fb7427b4700 1 -- 172.21.15.86:0/2521599176 shutdown_connections 2023-03-06T13:49:08.815 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:08.803+0000 7fb7427b4700 1 -- 172.21.15.86:0/2521599176 >> 172.21.15.86:0/2521599176 conn(0x7fb73c06c0d0 msgr2=0x7fb73c0c2150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T13:49:08.815 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:08.803+0000 7fb7427b4700 1 -- 172.21.15.86:0/2521599176 shutdown_connections 2023-03-06T13:49:08.816 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:08.803+0000 7fb7427b4700 1 -- 172.21.15.86:0/2521599176 wait complete. 2023-03-06T13:49:08.816 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:08.804+0000 7fb7427b4700 1 Processor -- start 2023-03-06T13:49:08.816 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:08.804+0000 7fb7427b4700 1 -- start start 2023-03-06T13:49:08.816 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:08.805+0000 7fb7427b4700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb73c0c07d0 0x7fb73c1e5640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:08.816 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:08.805+0000 7fb7427b4700 1 --2- >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7fb73c1437f0 0x7fb73c143c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:08.816 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:08.805+0000 7fb7427b4700 1 --2- >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fb73c1e8160 0x7fb73c1e85d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:08.817 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:08.805+0000 7fb7427b4700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb73c1433d0 con 0x7fb73c0c07d0 2023-03-06T13:49:08.817 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:08.805+0000 7fb7427b4700 1 -- --> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb73c144f70 con 0x7fb73c1437f0 2023-03-06T13:49:08.817 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:08.805+0000 7fb7427b4700 1 -- --> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb73c1441a0 con 0x7fb73c1e8160 2023-03-06T13:49:08.818 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:08.805+0000 7fb73bfff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb73c0c07d0 0x7fb73c1e5640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:08.818 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:08.805+0000 7fb73bfff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb73c0c07d0 0x7fb73c1e5640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:38406/0 (socket says 172.21.15.86:38406) 2023-03-06T13:49:08.818 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:08.805+0000 7fb73bfff700 1 -- 172.21.15.86:0/3353068798 learned_addr learned my addr 172.21.15.86:0/3353068798 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-03-06T13:49:08.818 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:08.805+0000 7fb740d51700 1 --2- 172.21.15.86:0/3353068798 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fb73c1e8160 0x7fb73c1e85d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:08.818 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:08.805+0000 7fb73bfff700 1 -- 172.21.15.86:0/3353068798 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fb73c1e8160 msgr2=0x7fb73c1e85d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:08.818 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:08.805+0000 7fb73b7fe700 1 --2- 172.21.15.86:0/3353068798 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7fb73c1437f0 0x7fb73c143c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:08.818 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:08.805+0000 7fb73bfff700 1 --2- 172.21.15.86:0/3353068798 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fb73c1e8160 0x7fb73c1e85d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:08.819 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:08.805+0000 7fb73bfff700 1 -- 172.21.15.86:0/3353068798 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7fb73c1437f0 msgr2=0x7fb73c143c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:08.819 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:08.805+0000 7fb73bfff700 1 --2- 172.21.15.86:0/3353068798 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7fb73c1437f0 0x7fb73c143c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:08.819 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:08.805+0000 7fb73bfff700 1 -- 172.21.15.86:0/3353068798 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb73c152fd0 con 0x7fb73c0c07d0 2023-03-06T13:49:08.819 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:08.805+0000 7fb740d51700 1 --2- 172.21.15.86:0/3353068798 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fb73c1e8160 0x7fb73c1e85d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-06T13:49:08.819 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:08.805+0000 7fb73b7fe700 1 --2- 172.21.15.86:0/3353068798 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7fb73c1437f0 0x7fb73c143c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-06T13:49:08.819 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:08.805+0000 7fb73bfff700 1 --2- 172.21.15.86:0/3353068798 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb73c0c07d0 0x7fb73c1e5640 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fb730011aa0 tx=0x7fb730011e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T13:49:08.819 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:08.805+0000 7fb738ff9700 1 -- 172.21.15.86:0/3353068798 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb73000f980 con 0x7fb73c0c07d0 2023-03-06T13:49:08.820 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:08.805+0000 7fb738ff9700 1 -- 172.21.15.86:0/3353068798 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb73000fb00 con 0x7fb73c0c07d0 2023-03-06T13:49:08.820 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:08.805+0000 7fb7427b4700 1 -- 172.21.15.86:0/3353068798 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb73c152cf0 con 0x7fb73c0c07d0 2023-03-06T13:49:08.820 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:08.805+0000 7fb738ff9700 1 -- 172.21.15.86:0/3353068798 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb73000feb0 con 0x7fb73c0c07d0 2023-03-06T13:49:08.820 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:08.805+0000 7fb7427b4700 1 -- 172.21.15.86:0/3353068798 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb73c06e610 con 0x7fb73c0c07d0 2023-03-06T13:49:08.820 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:08.806+0000 7fb7427b4700 1 -- 172.21.15.86:0/3353068798 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb73c04e750 con 0x7fb73c0c07d0 2023-03-06T13:49:08.820 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:08.807+0000 7fb738ff9700 1 -- 172.21.15.86:0/3353068798 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fb730014440 con 0x7fb73c0c07d0 2023-03-06T13:49:08.820 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:08.807+0000 7fb738ff9700 1 --2- 172.21.15.86:0/3353068798 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7fb7280682f0 0x7fb72806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:08.820 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:08.807+0000 7fb738ff9700 1 -- 172.21.15.86:0/3353068798 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fb730086210 con 0x7fb73c0c07d0 2023-03-06T13:49:08.821 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:08.807+0000 7fb73b7fe700 1 --2- 172.21.15.86:0/3353068798 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7fb7280682f0 0x7fb72806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:08.822 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:08.808+0000 7fb73b7fe700 1 --2- 172.21.15.86:0/3353068798 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7fb7280682f0 0x7fb72806a7a0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fb73c153510 tx=0x7fb72c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T13:49:08.822 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:08.811+0000 7fb738ff9700 1 -- 172.21.15.86:0/3353068798 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fb730052e20 con 0x7fb73c0c07d0 2023-03-06T13:49:08.993 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:08.992+0000 7fb7427b4700 1 -- 172.21.15.86:0/3353068798 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb73c143130 con 0x7fb73c0c07d0 2023-03-06T13:49:08.994 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:08.993+0000 7fb738ff9700 1 -- 172.21.15.86:0/3353068798 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v18) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb730056440 con 0x7fb73c0c07d0 2023-03-06T13:49:08.994 INFO:teuthology.orchestra.run.smithi086.stdout:pg_num: 1 2023-03-06T13:49:08.995 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:08.994+0000 7fb7427b4700 1 -- 172.21.15.86:0/3353068798 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7fb7280682f0 msgr2=0x7fb72806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:08.995 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:08.994+0000 7fb7427b4700 1 --2- 172.21.15.86:0/3353068798 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7fb7280682f0 0x7fb72806a7a0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fb73c153510 tx=0x7fb72c008040 comp rx=0 tx=0).stop 2023-03-06T13:49:08.996 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:08.994+0000 7fb7427b4700 1 -- 172.21.15.86:0/3353068798 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb73c0c07d0 msgr2=0x7fb73c1e5640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:08.996 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:08.994+0000 7fb7427b4700 1 --2- 172.21.15.86:0/3353068798 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb73c0c07d0 0x7fb73c1e5640 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fb730011aa0 tx=0x7fb730011e60 comp rx=0 tx=0).stop 2023-03-06T13:49:08.996 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:08.994+0000 7fb7427b4700 1 -- 172.21.15.86:0/3353068798 shutdown_connections 2023-03-06T13:49:08.996 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:08.994+0000 7fb7427b4700 1 --2- 172.21.15.86:0/3353068798 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7fb7280682f0 0x7fb72806a7a0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:08.996 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:08.994+0000 7fb7427b4700 1 --2- 172.21.15.86:0/3353068798 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb73c0c07d0 0x7fb73c1e5640 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:08.996 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:08.994+0000 7fb7427b4700 1 --2- 172.21.15.86:0/3353068798 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fb73c1e8160 0x7fb73c1e85d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:08.996 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:08.994+0000 7fb7427b4700 1 --2- 172.21.15.86:0/3353068798 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7fb73c1437f0 0x7fb73c143c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:08.997 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:08.994+0000 7fb7427b4700 1 -- 172.21.15.86:0/3353068798 >> 172.21.15.86:0/3353068798 conn(0x7fb73c06c0d0 msgr2=0x7fb73c147ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T13:49:08.997 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:08.995+0000 7fb7427b4700 1 -- 172.21.15.86:0/3353068798 shutdown_connections 2023-03-06T13:49:08.997 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:08.995+0000 7fb7427b4700 1 -- 172.21.15.86:0/3353068798 wait complete. 2023-03-06T13:49:09.007 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-03-06T13:49:09.130 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:09.129+0000 7f44d9017700 1 Processor -- start 2023-03-06T13:49:09.130 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:09.129+0000 7f44d9017700 1 -- start start 2023-03-06T13:49:09.132 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:09.129+0000 7f44d9017700 1 --2- >> v2:172.21.15.202:3300/0 conn(0x7f44d4149420 0x7f44d40c2860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:09.132 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:09.129+0000 7f44d9017700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f44d406ea90 0x7f44d4159a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:09.132 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:09.129+0000 7f44d9017700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44d4153340 con 0x7f44d40c2da0 2023-03-06T13:49:09.132 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:09.129+0000 7f44d9017700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44d41497f0 con 0x7f44d406ea90 2023-03-06T13:49:09.132 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:09.129+0000 7f44d9017700 1 -- --> v2:172.21.15.202:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44d4152750 con 0x7f44d4149420 2023-03-06T13:49:09.132 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:09.129+0000 7f44d359e700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f44d406ea90 0x7f44d4159a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:09.133 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:09.130+0000 7f44d359e700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f44d406ea90 0x7f44d4159a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:38418/0 (socket says 172.21.15.86:38418) 2023-03-06T13:49:09.133 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:09.130+0000 7f44d259c700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f44d40c2da0 0x7f44d414f0c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:48562/0 (socket says 172.21.15.86:48562) 2023-03-06T13:49:09.133 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:09.130+0000 7f44d359e700 1 -- 172.21.15.86:0/1418258419 learned_addr learned my addr 172.21.15.86:0/1418258419 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-03-06T13:49:09.133 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:09.130+0000 7f44d2d9d700 1 --2- 172.21.15.86:0/1418258419 >> v2:172.21.15.202:3300/0 conn(0x7f44d4149420 0x7f44d40c2860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:09.133 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:09.130+0000 7f44d359e700 1 -- 172.21.15.86:0/1418258419 >> v2:172.21.15.202:3300/0 conn(0x7f44d4149420 msgr2=0x7f44d40c2860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T13:49:09.133 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:09.130+0000 7f44d359e700 1 --2- 172.21.15.86:0/1418258419 >> v2:172.21.15.202:3300/0 conn(0x7f44d4149420 0x7f44d40c2860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:09.133 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:09.130+0000 7f44d359e700 1 -- 172.21.15.86:0/1418258419 >> v1:172.21.15.86:6789/0 conn(0x7f44d40c2da0 legacy=0x7f44d414f0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:09.134 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:09.130+0000 7f44d359e700 1 -- 172.21.15.86:0/1418258419 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44d4152a10 con 0x7f44d406ea90 2023-03-06T13:49:09.134 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:09.130+0000 7f44d1d9b700 1 -- 172.21.15.86:0/1418258419 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 57110091 0 0) 0x7f44d4153340 con 0x7f44d40c2da0 2023-03-06T13:49:09.134 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:09.130+0000 7f44d359e700 1 --2- 172.21.15.86:0/1418258419 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f44d406ea90 0x7f44d4159a40 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f44d4067e40 tx=0x7f44cc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11d5e7739d4555d5 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T13:49:09.134 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:09.130+0000 7f44d1d9b700 1 -- 172.21.15.86:0/1418258419 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44cc00e070 con 0x7f44d406ea90 2023-03-06T13:49:09.135 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:09.130+0000 7f44d1d9b700 1 -- 172.21.15.86:0/1418258419 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44cc00b910 con 0x7f44d406ea90 2023-03-06T13:49:09.135 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:09.130+0000 7f44d1d9b700 1 -- 172.21.15.86:0/1418258419 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44cc00bcc0 con 0x7f44d406ea90 2023-03-06T13:49:09.135 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:09.131+0000 7f44d9017700 1 -- 172.21.15.86:0/1418258419 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f44d406ea90 msgr2=0x7f44d4159a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:09.135 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:09.131+0000 7f44d9017700 1 --2- 172.21.15.86:0/1418258419 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f44d406ea90 0x7f44d4159a40 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f44d4067e40 tx=0x7f44cc00b330 comp rx=0 tx=0).stop 2023-03-06T13:49:09.135 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:09.131+0000 7f44d9017700 1 -- 172.21.15.86:0/1418258419 shutdown_connections 2023-03-06T13:49:09.135 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:09.131+0000 7f44d9017700 1 --2- 172.21.15.86:0/1418258419 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f44d406ea90 0x7f44d4159a40 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:09.135 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:09.131+0000 7f44d9017700 1 --2- 172.21.15.86:0/1418258419 >> v2:172.21.15.202:3300/0 conn(0x7f44d4149420 0x7f44d40c2860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:09.136 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:09.131+0000 7f44d9017700 1 -- 172.21.15.86:0/1418258419 >> 172.21.15.86:0/1418258419 conn(0x7f44d406c0d0 msgr2=0x7f44d40c2150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T13:49:09.136 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:09.131+0000 7f44d9017700 1 -- 172.21.15.86:0/1418258419 shutdown_connections 2023-03-06T13:49:09.136 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:09.131+0000 7f44d9017700 1 -- 172.21.15.86:0/1418258419 wait complete. 2023-03-06T13:49:09.138 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:09.132+0000 7f44d9017700 1 Processor -- start 2023-03-06T13:49:09.139 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:09.132+0000 7f44d9017700 1 -- start start 2023-03-06T13:49:09.139 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:09.133+0000 7f44d9017700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f44d406ea90 0x7f44d41466f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:09.139 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:09.133+0000 7f44d9017700 1 --2- >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f44d40c2da0 0x7f44d414cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:09.140 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:09.133+0000 7f44d9017700 1 --2- >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f44d4149420 0x7f44d414e680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:09.140 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:09.133+0000 7f44d9017700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44d40c2060 con 0x7f44d406ea90 2023-03-06T13:49:09.140 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:09.133+0000 7f44d9017700 1 -- --> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44d414f7e0 con 0x7f44d4149420 2023-03-06T13:49:09.140 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:09.133+0000 7f44d9017700 1 -- --> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44d4146c30 con 0x7f44d40c2da0 2023-03-06T13:49:09.140 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:09.133+0000 7f44d2d9d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f44d406ea90 0x7f44d41466f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:09.140 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:09.133+0000 7f44d2d9d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f44d406ea90 0x7f44d41466f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:38420/0 (socket says 172.21.15.86:38420) 2023-03-06T13:49:09.140 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:09.133+0000 7f44d2d9d700 1 -- 172.21.15.86:0/3959671091 learned_addr learned my addr 172.21.15.86:0/3959671091 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-03-06T13:49:09.140 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:09.133+0000 7f44d359e700 1 --2- 172.21.15.86:0/3959671091 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f44d4149420 0x7f44d414e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:09.141 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:09.133+0000 7f44d259c700 1 --2- 172.21.15.86:0/3959671091 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f44d40c2da0 0x7f44d414cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:09.141 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:09.133+0000 7f44d2d9d700 1 -- 172.21.15.86:0/3959671091 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f44d40c2da0 msgr2=0x7f44d414cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:09.141 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:09.133+0000 7f44d2d9d700 1 --2- 172.21.15.86:0/3959671091 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f44d40c2da0 0x7f44d414cd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:09.141 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:09.133+0000 7f44d2d9d700 1 -- 172.21.15.86:0/3959671091 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f44d4149420 msgr2=0x7f44d414e680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:09.141 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:09.133+0000 7f44d2d9d700 1 --2- 172.21.15.86:0/3959671091 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f44d4149420 0x7f44d414e680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:09.141 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:09.133+0000 7f44d2d9d700 1 -- 172.21.15.86:0/3959671091 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44cc009b30 con 0x7f44d406ea90 2023-03-06T13:49:09.141 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:09.133+0000 7f44d259c700 1 --2- 172.21.15.86:0/3959671091 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f44d40c2da0 0x7f44d414cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-06T13:49:09.142 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:09.133+0000 7f44d2d9d700 1 --2- 172.21.15.86:0/3959671091 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f44d406ea90 0x7f44d41466f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f44c400e8a0 tx=0x7f44c400ec60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T13:49:09.142 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:09.133+0000 7f44bb7fe700 1 -- 172.21.15.86:0/3959671091 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44c4009590 con 0x7f44d406ea90 2023-03-06T13:49:09.142 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:09.133+0000 7f44bb7fe700 1 -- 172.21.15.86:0/3959671091 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44c400eea0 con 0x7f44d406ea90 2023-03-06T13:49:09.142 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:09.133+0000 7f44bb7fe700 1 -- 172.21.15.86:0/3959671091 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44c400ca50 con 0x7f44d406ea90 2023-03-06T13:49:09.142 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:09.133+0000 7f44d9017700 1 -- 172.21.15.86:0/3959671091 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44d4152fd0 con 0x7f44d406ea90 2023-03-06T13:49:09.142 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:09.133+0000 7f44d9017700 1 -- 172.21.15.86:0/3959671091 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44d4152cf0 con 0x7f44d406ea90 2023-03-06T13:49:09.142 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:09.134+0000 7f44d9017700 1 -- 172.21.15.86:0/3959671091 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44d406e610 con 0x7f44d406ea90 2023-03-06T13:49:09.142 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:09.135+0000 7f44bb7fe700 1 -- 172.21.15.86:0/3959671091 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f44c4019030 con 0x7f44d406ea90 2023-03-06T13:49:09.143 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:09.135+0000 7f44bb7fe700 1 --2- 172.21.15.86:0/3959671091 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7f44c00682f0 0x7f44c006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:09.143 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:09.135+0000 7f44bb7fe700 1 -- 172.21.15.86:0/3959671091 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f44c40857e0 con 0x7f44d406ea90 2023-03-06T13:49:09.143 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:09.135+0000 7f44d259c700 1 --2- 172.21.15.86:0/3959671091 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7f44c00682f0 0x7f44c006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:09.143 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:09.135+0000 7f44d259c700 1 --2- 172.21.15.86:0/3959671091 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7f44c00682f0 0x7f44c006a7a0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f44c8000f60 tx=0x7f44c8009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T13:49:09.143 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:09.139+0000 7f44bb7fe700 1 -- 172.21.15.86:0/3959671091 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f44c4052330 con 0x7f44d406ea90 2023-03-06T13:49:09.323 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:09.322+0000 7f44d9017700 1 -- 172.21.15.86:0/3959671091 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f44d414f590 con 0x7f44d406ea90 2023-03-06T13:49:09.324 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:09.323+0000 7f44bb7fe700 1 -- 172.21.15.86:0/3959671091 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v19) v1 ==== 92+0+10 (secure 0 0 0) 0x7f44c4055950 con 0x7f44d406ea90 2023-03-06T13:49:09.324 INFO:teuthology.orchestra.run.smithi086.stdout:pg_num: 8 2023-03-06T13:49:09.326 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:09.325+0000 7f44d9017700 1 -- 172.21.15.86:0/3959671091 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7f44c00682f0 msgr2=0x7f44c006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:09.326 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:09.325+0000 7f44d9017700 1 --2- 172.21.15.86:0/3959671091 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7f44c00682f0 0x7f44c006a7a0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f44c8000f60 tx=0x7f44c8009040 comp rx=0 tx=0).stop 2023-03-06T13:49:09.326 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:09.325+0000 7f44d9017700 1 -- 172.21.15.86:0/3959671091 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f44d406ea90 msgr2=0x7f44d41466f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:09.326 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:09.325+0000 7f44d9017700 1 --2- 172.21.15.86:0/3959671091 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f44d406ea90 0x7f44d41466f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f44c400e8a0 tx=0x7f44c400ec60 comp rx=0 tx=0).stop 2023-03-06T13:49:09.326 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:09.325+0000 7f44d9017700 1 -- 172.21.15.86:0/3959671091 shutdown_connections 2023-03-06T13:49:09.326 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:09.325+0000 7f44d9017700 1 --2- 172.21.15.86:0/3959671091 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7f44c00682f0 0x7f44c006a7a0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:09.327 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:09.325+0000 7f44d9017700 1 --2- 172.21.15.86:0/3959671091 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f44d406ea90 0x7f44d41466f0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:09.327 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:09.325+0000 7f44d9017700 1 --2- 172.21.15.86:0/3959671091 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f44d4149420 0x7f44d414e680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:09.327 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:09.325+0000 7f44d9017700 1 --2- 172.21.15.86:0/3959671091 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f44d40c2da0 0x7f44d414cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:09.327 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:09.325+0000 7f44d9017700 1 -- 172.21.15.86:0/3959671091 >> 172.21.15.86:0/3959671091 conn(0x7f44d406c0d0 msgr2=0x7f44d4147420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T13:49:09.327 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:09.325+0000 7f44d9017700 1 -- 172.21.15.86:0/3959671091 shutdown_connections 2023-03-06T13:49:09.327 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:09.325+0000 7f44d9017700 1 -- 172.21.15.86:0/3959671091 wait complete. 2023-03-06T13:49:09.338 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-03-06T13:49:09.459 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:09.458+0000 7fef2ab41700 1 Processor -- start 2023-03-06T13:49:09.459 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:09.458+0000 7fef2ab41700 1 -- start start 2023-03-06T13:49:09.466 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:09.459+0000 7fef2ab41700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fef240c1190 0x7fef240bd810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:09.467 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:09.459+0000 7fef2ab41700 1 --2- >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fef2414fc60 0x7fef24150100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:09.467 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:09.459+0000 7fef2ab41700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef240bfdf0 con 0x7fef2406a330 2023-03-06T13:49:09.467 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:09.459+0000 7fef2ab41700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef24150640 con 0x7fef240c1190 2023-03-06T13:49:09.468 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:09.459+0000 7fef2ab41700 1 -- --> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef240c0a20 con 0x7fef2414fc60 2023-03-06T13:49:09.468 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:09.459+0000 7fef288dd700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fef240c1190 0x7fef240bd810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:09.468 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:09.459+0000 7fef290de700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7fef2406a330 0x7fef2406a750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:48584/0 (socket says 172.21.15.86:48584) 2023-03-06T13:49:09.468 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:09.459+0000 7fef290de700 1 -- 172.21.15.86:0/749296249 learned_addr learned my addr 172.21.15.86:0/749296249 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-03-06T13:49:09.469 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:09.459+0000 7fef23fff700 1 --2- 172.21.15.86:0/749296249 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fef2414fc60 0x7fef24150100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:09.469 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:09.459+0000 7fef288dd700 1 -- 172.21.15.86:0/749296249 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fef2414fc60 msgr2=0x7fef24150100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T13:49:09.469 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:09.459+0000 7fef288dd700 1 --2- 172.21.15.86:0/749296249 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fef2414fc60 0x7fef24150100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:09.469 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:09.459+0000 7fef288dd700 1 -- 172.21.15.86:0/749296249 >> v1:172.21.15.86:6789/0 conn(0x7fef2406a330 legacy=0x7fef2406a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:09.470 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:09.459+0000 7fef288dd700 1 -- 172.21.15.86:0/749296249 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef240bf6e0 con 0x7fef240c1190 2023-03-06T13:49:09.470 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:09.459+0000 7fef237fe700 1 -- 172.21.15.86:0/749296249 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1901406252 0 0) 0x7fef240bfdf0 con 0x7fef2406a330 2023-03-06T13:49:09.470 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:09.459+0000 7fef288dd700 1 --2- 172.21.15.86:0/749296249 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fef240c1190 0x7fef240bd810 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fef18009840 tx=0x7fef18009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b1cabea42437138 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T13:49:09.470 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:09.459+0000 7fef237fe700 1 -- 172.21.15.86:0/749296249 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef18011830 con 0x7fef240c1190 2023-03-06T13:49:09.471 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:09.460+0000 7fef237fe700 1 -- 172.21.15.86:0/749296249 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef18011990 con 0x7fef240c1190 2023-03-06T13:49:09.471 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:09.460+0000 7fef237fe700 1 -- 172.21.15.86:0/749296249 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef18011d20 con 0x7fef240c1190 2023-03-06T13:49:09.471 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:09.460+0000 7fef2ab41700 1 -- 172.21.15.86:0/749296249 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fef240c1190 msgr2=0x7fef240bd810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:09.471 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:09.460+0000 7fef2ab41700 1 --2- 172.21.15.86:0/749296249 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fef240c1190 0x7fef240bd810 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fef18009840 tx=0x7fef18009b50 comp rx=0 tx=0).stop 2023-03-06T13:49:09.471 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:09.460+0000 7fef2ab41700 1 -- 172.21.15.86:0/749296249 shutdown_connections 2023-03-06T13:49:09.471 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:09.460+0000 7fef2ab41700 1 --2- 172.21.15.86:0/749296249 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fef240c1190 0x7fef240bd810 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:09.472 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:09.460+0000 7fef2ab41700 1 --2- 172.21.15.86:0/749296249 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fef2414fc60 0x7fef24150100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:09.472 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:09.460+0000 7fef2ab41700 1 -- 172.21.15.86:0/749296249 >> 172.21.15.86:0/749296249 conn(0x7fef240c1900 msgr2=0x7fef240c1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T13:49:09.472 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:09.460+0000 7fef2ab41700 1 -- 172.21.15.86:0/749296249 shutdown_connections 2023-03-06T13:49:09.472 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:09.460+0000 7fef2ab41700 1 -- 172.21.15.86:0/749296249 wait complete. 2023-03-06T13:49:09.472 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:09.461+0000 7fef2ab41700 1 Processor -- start 2023-03-06T13:49:09.472 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:09.461+0000 7fef2ab41700 1 -- start start 2023-03-06T13:49:09.472 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:09.462+0000 7fef2ab41700 1 --2- >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7fef2406a330 0x7fef240a5af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:09.472 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:09.462+0000 7fef2ab41700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fef240c1190 0x7fef241d8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:09.473 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:09.462+0000 7fef2ab41700 1 --2- >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fef2414fc60 0x7fef24149c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:09.473 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:09.462+0000 7fef2ab41700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef2414e530 con 0x7fef240c1190 2023-03-06T13:49:09.473 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:09.462+0000 7fef2ab41700 1 -- --> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef241d8ff0 con 0x7fef2406a330 2023-03-06T13:49:09.473 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:09.462+0000 7fef2ab41700 1 -- --> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef240a60d0 con 0x7fef2414fc60 2023-03-06T13:49:09.473 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:09.462+0000 7fef23fff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fef240c1190 0x7fef241d8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:09.473 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:09.462+0000 7fef23fff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fef240c1190 0x7fef241d8ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:38440/0 (socket says 172.21.15.86:38440) 2023-03-06T13:49:09.474 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:09.462+0000 7fef23fff700 1 -- 172.21.15.86:0/3961520953 learned_addr learned my addr 172.21.15.86:0/3961520953 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-03-06T13:49:09.474 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:09.462+0000 7fef290de700 1 --2- 172.21.15.86:0/3961520953 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fef2414fc60 0x7fef24149c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:09.474 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:09.462+0000 7fef288dd700 1 --2- 172.21.15.86:0/3961520953 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7fef2406a330 0x7fef240a5af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:09.474 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:09.462+0000 7fef23fff700 1 -- 172.21.15.86:0/3961520953 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fef2414fc60 msgr2=0x7fef24149c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:09.474 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:09.462+0000 7fef23fff700 1 --2- 172.21.15.86:0/3961520953 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fef2414fc60 0x7fef24149c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:09.474 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:09.462+0000 7fef23fff700 1 -- 172.21.15.86:0/3961520953 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7fef2406a330 msgr2=0x7fef240a5af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:09.474 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:09.462+0000 7fef23fff700 1 --2- 172.21.15.86:0/3961520953 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7fef2406a330 0x7fef240a5af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:09.475 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:09.462+0000 7fef23fff700 1 -- 172.21.15.86:0/3961520953 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef180094a0 con 0x7fef240c1190 2023-03-06T13:49:09.475 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:09.462+0000 7fef290de700 1 --2- 172.21.15.86:0/3961520953 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fef2414fc60 0x7fef24149c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-06T13:49:09.475 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:09.462+0000 7fef288dd700 1 --2- 172.21.15.86:0/3961520953 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7fef2406a330 0x7fef240a5af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-06T13:49:09.475 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:09.462+0000 7fef23fff700 1 --2- 172.21.15.86:0/3961520953 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fef240c1190 0x7fef241d8ab0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fef1000e8a0 tx=0x7fef1000ec60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T13:49:09.475 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:09.463+0000 7fef217fa700 1 -- 172.21.15.86:0/3961520953 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef10009590 con 0x7fef240c1190 2023-03-06T13:49:09.475 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:09.463+0000 7fef217fa700 1 -- 172.21.15.86:0/3961520953 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef1000eea0 con 0x7fef240c1190 2023-03-06T13:49:09.475 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:09.463+0000 7fef2ab41700 1 -- 172.21.15.86:0/3961520953 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef240c0040 con 0x7fef240c1190 2023-03-06T13:49:09.475 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:09.463+0000 7fef217fa700 1 -- 172.21.15.86:0/3961520953 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef1000ca50 con 0x7fef240c1190 2023-03-06T13:49:09.476 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:09.463+0000 7fef2ab41700 1 -- 172.21.15.86:0/3961520953 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef2406fe10 con 0x7fef240c1190 2023-03-06T13:49:09.476 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:09.463+0000 7fef2ab41700 1 -- 172.21.15.86:0/3961520953 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef240bf980 con 0x7fef240c1190 2023-03-06T13:49:09.476 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:09.464+0000 7fef217fa700 1 -- 172.21.15.86:0/3961520953 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fef10023070 con 0x7fef240c1190 2023-03-06T13:49:09.476 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:09.464+0000 7fef217fa700 1 --2- 172.21.15.86:0/3961520953 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7fef080682f0 0x7fef0806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:09.476 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:09.464+0000 7fef217fa700 1 -- 172.21.15.86:0/3961520953 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fef10085ae0 con 0x7fef240c1190 2023-03-06T13:49:09.476 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:09.464+0000 7fef288dd700 1 --2- 172.21.15.86:0/3961520953 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7fef080682f0 0x7fef0806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:09.476 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:09.465+0000 7fef288dd700 1 --2- 172.21.15.86:0/3961520953 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7fef080682f0 0x7fef0806a7a0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fef18000c00 tx=0x7fef18008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T13:49:09.477 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:09.469+0000 7fef217fa700 1 -- 172.21.15.86:0/3961520953 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fef10052630 con 0x7fef240c1190 2023-03-06T13:49:09.692 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:09.691+0000 7fef2ab41700 1 -- 172.21.15.86:0/3961520953 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fef2404e750 con 0x7fef240c1190 2023-03-06T13:49:09.693 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:09.692+0000 7fef217fa700 1 -- 172.21.15.86:0/3961520953 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3524 (secure 0 0 0) 0x7fef10017de0 con 0x7fef240c1190 2023-03-06T13:49:09.694 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-03-06T13:49:09.694 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4262,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.202:6835/1375345216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.202:6833","nonce":1375345216},{"type":"v1","addr":"172.21.15.202:6835","nonce":1375345216}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4275,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6835/3217070924","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":3217070924},{"type":"v1","addr":"172.21.15.86:6835","nonce":3217070924}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4278,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/249061809","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6836","nonce":249061809},{"type":"v1","addr":"172.21.15.86:6837","nonce":249061809}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4300,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.202:6834/142821572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.202:6832","nonce":142821572},{"type":"v1","addr":"172.21.15.202:6834","nonce":142821572}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[]} 2023-03-06T13:49:09.696 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:09.694+0000 7fef2ab41700 1 -- 172.21.15.86:0/3961520953 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7fef080682f0 msgr2=0x7fef0806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:09.696 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:09.694+0000 7fef2ab41700 1 --2- 172.21.15.86:0/3961520953 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7fef080682f0 0x7fef0806a7a0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fef18000c00 tx=0x7fef18008030 comp rx=0 tx=0).stop 2023-03-06T13:49:09.696 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:09.694+0000 7fef2ab41700 1 -- 172.21.15.86:0/3961520953 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fef240c1190 msgr2=0x7fef241d8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:09.697 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:09.694+0000 7fef2ab41700 1 --2- 172.21.15.86:0/3961520953 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fef240c1190 0x7fef241d8ab0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fef1000e8a0 tx=0x7fef1000ec60 comp rx=0 tx=0).stop 2023-03-06T13:49:09.697 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:09.694+0000 7fef2ab41700 1 -- 172.21.15.86:0/3961520953 shutdown_connections 2023-03-06T13:49:09.697 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:09.694+0000 7fef2ab41700 1 --2- 172.21.15.86:0/3961520953 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7fef080682f0 0x7fef0806a7a0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:09.698 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:09.694+0000 7fef2ab41700 1 --2- 172.21.15.86:0/3961520953 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fef2414fc60 0x7fef24149c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:09.698 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:09.694+0000 7fef2ab41700 1 --2- 172.21.15.86:0/3961520953 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7fef2406a330 0x7fef240a5af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:09.698 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:09.694+0000 7fef2ab41700 1 --2- 172.21.15.86:0/3961520953 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fef240c1190 0x7fef241d8ab0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:09.699 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:09.694+0000 7fef2ab41700 1 -- 172.21.15.86:0/3961520953 >> 172.21.15.86:0/3961520953 conn(0x7fef240c1900 msgr2=0x7fef2406d0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T13:49:09.699 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:09.694+0000 7fef2ab41700 1 -- 172.21.15.86:0/3961520953 shutdown_connections 2023-03-06T13:49:09.699 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:09.694+0000 7fef2ab41700 1 -- 172.21.15.86:0/3961520953 wait complete. 2023-03-06T13:49:09.699 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 3 2023-03-06T13:49:09.707 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-03-06T13:49:09.827 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:09.826+0000 7f0707aea700 1 Processor -- start 2023-03-06T13:49:09.828 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:09.827+0000 7f0707aea700 1 -- start start 2023-03-06T13:49:09.830 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:09.827+0000 7f0707aea700 1 --2- >> v2:172.21.15.202:3300/0 conn(0x7f07000c3940 0x7f07000c3d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:09.831 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:09.827+0000 7f0707aea700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07000b9240 con 0x7f070006fbb0 2023-03-06T13:49:09.831 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:09.827+0000 7f0707aea700 1 -- --> v1:172.21.15.202:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f070006f730 con 0x7f0700150c30 2023-03-06T13:49:09.831 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:09.827+0000 7f0707aea700 1 -- --> v2:172.21.15.202:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07000b8580 con 0x7f07000c3940 2023-03-06T13:49:09.831 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:09.827+0000 7f0705085700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f070006fbb0 0x7f0700150520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:48594/0 (socket says 172.21.15.86:48594) 2023-03-06T13:49:09.831 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:09.827+0000 7f0705085700 1 -- 172.21.15.86:0/404706702 learned_addr learned my addr 172.21.15.86:0/404706702 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-03-06T13:49:09.831 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:09.828+0000 7f0705886700 1 --2- 172.21.15.86:0/404706702 >> v2:172.21.15.202:3300/0 conn(0x7f07000c3940 0x7f07000c3d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:09.831 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:09.828+0000 7f0704884700 1 -- 172.21.15.86:0/404706702 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1906171217 0 0) 0x7f07000b9240 con 0x7f070006fbb0 2023-03-06T13:49:09.832 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:09.828+0000 7f0704884700 1 -- 172.21.15.86:0/404706702 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f06ec0035b0 con 0x7f070006fbb0 2023-03-06T13:49:09.832 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:09.828+0000 7f0704884700 1 -- 172.21.15.86:0/404706702 <== mon.0 v1:172.21.15.86:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2384370808 0 0) 0x7f06ec0035b0 con 0x7f070006fbb0 2023-03-06T13:49:09.832 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:09.828+0000 7f0704884700 1 -- 172.21.15.86:0/404706702 >> v2:172.21.15.202:3300/0 conn(0x7f07000c3940 msgr2=0x7f07000c3d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T13:49:09.832 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:09.828+0000 7f0704884700 1 --2- 172.21.15.86:0/404706702 >> v2:172.21.15.202:3300/0 conn(0x7f07000c3940 0x7f07000c3d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:09.832 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:09.828+0000 7f0704884700 1 -- 172.21.15.86:0/404706702 >> v1:172.21.15.202:6789/0 conn(0x7f0700150c30 legacy=0x7f07001578b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:09.832 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:09.828+0000 7f0704884700 1 -- 172.21.15.86:0/404706702 --> v1:172.21.15.86:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f070014deb0 con 0x7f070006fbb0 2023-03-06T13:49:09.832 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:09.828+0000 7f0704884700 1 -- 172.21.15.86:0/404706702 <== mon.0 v1:172.21.15.86:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2191261126 0 0) 0x7f06fc001670 con 0x7f070006fbb0 2023-03-06T13:49:09.833 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:09.828+0000 7f0704884700 1 -- 172.21.15.86:0/404706702 >> v1:172.21.15.86:6789/0 conn(0x7f070006fbb0 legacy=0x7f0700150520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:09.833 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:09.828+0000 7f0704884700 1 --2- 172.21.15.86:0/404706702 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f06ec003a70 0x7f06ec003e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:09.833 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:09.828+0000 7f0704884700 1 --2- 172.21.15.86:0/404706702 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f06ec004850 0x7f06ec004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:09.833 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:09.828+0000 7f0704884700 1 --2- 172.21.15.86:0/404706702 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f06ec005250 0x7f06ec00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:09.833 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:09.828+0000 7f0704884700 1 -- 172.21.15.86:0/404706702 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07000b8580 con 0x7f06ec003a70 2023-03-06T13:49:09.833 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:09.828+0000 7f0704884700 1 -- 172.21.15.86:0/404706702 --> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06ec00c190 con 0x7f06ec005250 2023-03-06T13:49:09.833 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:09.828+0000 7f0704884700 1 -- 172.21.15.86:0/404706702 --> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06ec00c350 con 0x7f06ec004850 2023-03-06T13:49:09.833 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:09.828+0000 7f0705886700 1 --2- 172.21.15.86:0/404706702 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f06ec003a70 0x7f06ec003e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:09.834 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:09.828+0000 7f0705085700 1 --2- 172.21.15.86:0/404706702 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f06ec004850 0x7f06ec004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:09.834 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:09.828+0000 7f0706087700 1 --2- 172.21.15.86:0/404706702 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f06ec005250 0x7f06ec00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:09.834 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:09.828+0000 7f0705886700 1 -- 172.21.15.86:0/404706702 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f06ec004850 msgr2=0x7f06ec004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T13:49:09.834 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:09.828+0000 7f0705886700 1 --2- 172.21.15.86:0/404706702 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f06ec004850 0x7f06ec004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:09.834 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:09.828+0000 7f0705886700 1 -- 172.21.15.86:0/404706702 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f06ec005250 msgr2=0x7f06ec00ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T13:49:09.834 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:09.828+0000 7f0705886700 1 --2- 172.21.15.86:0/404706702 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f06ec005250 0x7f06ec00ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:09.834 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:09.828+0000 7f0705886700 1 -- 172.21.15.86:0/404706702 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06ec0035b0 con 0x7f06ec003a70 2023-03-06T13:49:09.835 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:09.828+0000 7f0705085700 1 --2- 172.21.15.86:0/404706702 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f06ec004850 0x7f06ec004cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-06T13:49:09.835 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:09.828+0000 7f0706087700 1 --2- 172.21.15.86:0/404706702 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f06ec005250 0x7f06ec00ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-06T13:49:09.835 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:09.828+0000 7f0706087700 1 -- 172.21.15.86:0/404706702 reap_dead start 2023-03-06T13:49:09.835 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:09.828+0000 7f0705886700 1 --2- 172.21.15.86:0/404706702 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f06ec003a70 0x7f06ec003e80 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f06f0009b30 tx=0x7f06ec005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64d42de538d322dd server_cookie=0 in_seq=0 out_seq=0 2023-03-06T13:49:09.835 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:09.829+0000 7f0704884700 1 -- 172.21.15.86:0/404706702 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06f000e6c0 con 0x7f06ec003a70 2023-03-06T13:49:09.835 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:09.829+0000 7f0704884700 1 -- 172.21.15.86:0/404706702 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06f000e820 con 0x7f06ec003a70 2023-03-06T13:49:09.836 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:09.829+0000 7f0704884700 1 -- 172.21.15.86:0/404706702 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06f000eb90 con 0x7f06ec003a70 2023-03-06T13:49:09.836 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:09.829+0000 7f0707aea700 1 -- 172.21.15.86:0/404706702 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f06ec003a70 msgr2=0x7f06ec003e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:09.836 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:09.829+0000 7f0707aea700 1 --2- 172.21.15.86:0/404706702 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f06ec003a70 0x7f06ec003e80 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f06f0009b30 tx=0x7f06ec005880 comp rx=0 tx=0).stop 2023-03-06T13:49:09.836 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:09.829+0000 7f0707aea700 1 -- 172.21.15.86:0/404706702 shutdown_connections 2023-03-06T13:49:09.836 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:09.829+0000 7f0707aea700 1 --2- 172.21.15.86:0/404706702 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f06ec003a70 0x7f06ec003e80 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:09.836 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:09.829+0000 7f0707aea700 1 -- 172.21.15.86:0/404706702 >> 172.21.15.86:0/404706702 conn(0x7f070006af80 msgr2=0x7f07000c3230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T13:49:09.837 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:09.829+0000 7f0707aea700 1 -- 172.21.15.86:0/404706702 shutdown_connections 2023-03-06T13:49:09.837 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:09.829+0000 7f0707aea700 1 -- 172.21.15.86:0/404706702 wait complete. 2023-03-06T13:49:09.841 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:09.831+0000 7f0707aea700 1 Processor -- start 2023-03-06T13:49:09.841 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:09.831+0000 7f0707aea700 1 -- start start 2023-03-06T13:49:09.842 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:09.832+0000 7f0707aea700 1 --2- >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f06ec003a70 0x7f07001494f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:09.842 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:09.832+0000 7f0707aea700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0700145d50 0x7f07001461a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:09.842 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:09.832+0000 7f0707aea700 1 --2- >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f0700147e10 0x7f0700148280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:09.843 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:09.832+0000 7f0707aea700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f070014bd20 con 0x7f0700145d50 2023-03-06T13:49:09.843 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:09.832+0000 7f0707aea700 1 -- --> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0700147ba0 con 0x7f06ec003a70 2023-03-06T13:49:09.843 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:09.832+0000 7f0707aea700 1 -- --> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07001466e0 con 0x7f0700147e10 2023-03-06T13:49:09.843 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:09.832+0000 7f0705085700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0700145d50 0x7f07001461a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:09.844 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:09.832+0000 7f0705085700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0700145d50 0x7f07001461a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:38458/0 (socket says 172.21.15.86:38458) 2023-03-06T13:49:09.844 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:09.832+0000 7f0705085700 1 -- 172.21.15.86:0/1119258917 learned_addr learned my addr 172.21.15.86:0/1119258917 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-03-06T13:49:09.844 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:09.832+0000 7f0705886700 1 --2- 172.21.15.86:0/1119258917 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f06ec003a70 0x7f07001494f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:09.844 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:09.832+0000 7f0705085700 1 -- 172.21.15.86:0/1119258917 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f0700147e10 msgr2=0x7f0700148280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:09.845 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:09.832+0000 7f0705085700 1 --2- 172.21.15.86:0/1119258917 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f0700147e10 0x7f0700148280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:09.845 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:09.832+0000 7f0705085700 1 -- 172.21.15.86:0/1119258917 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f06ec003a70 msgr2=0x7f07001494f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:09.845 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:09.832+0000 7f0705085700 1 --2- 172.21.15.86:0/1119258917 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f06ec003a70 0x7f07001494f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:09.846 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:09.832+0000 7f0705085700 1 -- 172.21.15.86:0/1119258917 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07000b9790 con 0x7f0700145d50 2023-03-06T13:49:09.846 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:09.832+0000 7f0705085700 1 --2- 172.21.15.86:0/1119258917 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0700145d50 0x7f07001461a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f06fc00eaa0 tx=0x7f06fc00ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T13:49:09.846 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:09.832+0000 7f06f67fc700 1 -- 172.21.15.86:0/1119258917 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06fc005e50 con 0x7f0700145d50 2023-03-06T13:49:09.846 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:09.832+0000 7f06f67fc700 1 -- 172.21.15.86:0/1119258917 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06fc00c6e0 con 0x7f0700145d50 2023-03-06T13:49:09.847 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:09.832+0000 7f06f67fc700 1 -- 172.21.15.86:0/1119258917 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06fc00ca50 con 0x7f0700145d50 2023-03-06T13:49:09.847 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:09.832+0000 7f0707aea700 1 -- 172.21.15.86:0/1119258917 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07001475f0 con 0x7f0700145d50 2023-03-06T13:49:09.847 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:09.832+0000 7f0707aea700 1 -- 172.21.15.86:0/1119258917 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07000b9a70 con 0x7f0700145d50 2023-03-06T13:49:09.848 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:09.833+0000 7f0707aea700 1 -- 172.21.15.86:0/1119258917 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0700145ba0 con 0x7f0700145d50 2023-03-06T13:49:09.848 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:09.833+0000 7f06f67fc700 1 -- 172.21.15.86:0/1119258917 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f06fc00cbb0 con 0x7f0700145d50 2023-03-06T13:49:09.848 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:09.834+0000 7f06f67fc700 1 --2- 172.21.15.86:0/1119258917 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7f06e40682f0 0x7f06e406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:09.848 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:09.834+0000 7f06f67fc700 1 -- 172.21.15.86:0/1119258917 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f06fc085840 con 0x7f0700145d50 2023-03-06T13:49:09.849 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:09.834+0000 7f0705886700 1 --2- 172.21.15.86:0/1119258917 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7f06e40682f0 0x7f06e406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:09.849 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:09.834+0000 7f0705886700 1 --2- 172.21.15.86:0/1119258917 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7f06e40682f0 0x7f06e406a7a0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f06f00090b0 tx=0x7f06f0008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T13:49:09.849 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:09.838+0000 7f06f67fc700 1 -- 172.21.15.86:0/1119258917 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f06fc0523f0 con 0x7f0700145d50 2023-03-06T13:49:10.022 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:10.021+0000 7f0707aea700 1 -- 172.21.15.86:0/1119258917 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f070004e750 con 0x7f0700145d50 2023-03-06T13:49:10.023 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:10.022+0000 7f06f67fc700 1 -- 172.21.15.86:0/1119258917 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+14168 (secure 0 0 0) 0x7f06fc055a10 con 0x7f0700145d50 2023-03-06T13:49:10.023 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-03-06T13:49:10.023 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":19,"fsid":"2cca6c77-50cb-47d8-a8c7-444575d01327","created":"2023-03-06T13:48:48.337369+0000","modified":"2023-03-06T13:49:09.294238+0000","last_up_change":"2023-03-06T13:48:59.782729+0000","last_in_change":"2023-03-06T13:48:50.777249+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-03-06T13:48:59.879087+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-03-06T13:49:06.686394+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2de68e69-e10f-49e1-a15a-8a9bfff504c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":96739},{"type":"v1","addr":"172.21.15.86:6816","nonce":96739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":96739},{"type":"v1","addr":"172.21.15.86:6819","nonce":96739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":96739},{"type":"v1","addr":"172.21.15.86:6823","nonce":96739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":96739},{"type":"v1","addr":"172.21.15.86:6821","nonce":96739}]},"public_addr":"172.21.15.86:6816/96739","cluster_addr":"172.21.15.86:6819/96739","heartbeat_back_addr":"172.21.15.86:6823/96739","heartbeat_front_addr":"172.21.15.86:6821/96739","state":["exists","up"]},{"osd":1,"uuid":"3e75c061-0de5-4742-a20d-4b5a4adb9b81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":96738},{"type":"v1","addr":"172.21.15.86:6801","nonce":96738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":96738},{"type":"v1","addr":"172.21.15.86:6803","nonce":96738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":96738},{"type":"v1","addr":"172.21.15.86:6807","nonce":96738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":96738},{"type":"v1","addr":"172.21.15.86:6805","nonce":96738}]},"public_addr":"172.21.15.86:6801/96738","cluster_addr":"172.21.15.86:6803/96738","heartbeat_back_addr":"172.21.15.86:6807/96738","heartbeat_front_addr":"172.21.15.86:6805/96738","state":["exists","up"]},{"osd":2,"uuid":"38d71bce-81c2-4e33-91e1-65efb08f2291","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":96740},{"type":"v1","addr":"172.21.15.86:6809","nonce":96740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":96740},{"type":"v1","addr":"172.21.15.86:6811","nonce":96740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6815","nonce":96740},{"type":"v1","addr":"172.21.15.86:6817","nonce":96740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":96740},{"type":"v1","addr":"172.21.15.86:6813","nonce":96740}]},"public_addr":"172.21.15.86:6809/96740","cluster_addr":"172.21.15.86:6811/96740","heartbeat_back_addr":"172.21.15.86:6817/96740","heartbeat_front_addr":"172.21.15.86:6813/96740","state":["exists","up"]},{"osd":3,"uuid":"d95a2686-21bd-4b66-9ea5-eef65403935b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":96756},{"type":"v1","addr":"172.21.15.86:6825","nonce":96756}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":96756},{"type":"v1","addr":"172.21.15.86:6827","nonce":96756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":96756},{"type":"v1","addr":"172.21.15.86:6831","nonce":96756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":96756},{"type":"v1","addr":"172.21.15.86:6829","nonce":96756}]},"public_addr":"172.21.15.86:6825/96756","cluster_addr":"172.21.15.86:6827/96756","heartbeat_back_addr":"172.21.15.86:6831/96756","heartbeat_front_addr":"172.21.15.86:6829/96756","state":["exists","up"]},{"osd":4,"uuid":"98c7e359-0f00-496a-8aaa-5472af355e48","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.202:6816","nonce":96847},{"type":"v1","addr":"172.21.15.202:6817","nonce":96847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.202:6818","nonce":96847},{"type":"v1","addr":"172.21.15.202:6819","nonce":96847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.202:6822","nonce":96847},{"type":"v1","addr":"172.21.15.202:6823","nonce":96847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.202:6820","nonce":96847},{"type":"v1","addr":"172.21.15.202:6821","nonce":96847}]},"public_addr":"172.21.15.202:6817/96847","cluster_addr":"172.21.15.202:6819/96847","heartbeat_back_addr":"172.21.15.202:6823/96847","heartbeat_front_addr":"172.21.15.202:6821/96847","state":["exists","up"]},{"osd":5,"uuid":"fa6688d9-73f3-4593-a50e-d96a0fe5f4cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.202:6824","nonce":96848},{"type":"v1","addr":"172.21.15.202:6825","nonce":96848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.202:6826","nonce":96848},{"type":"v1","addr":"172.21.15.202:6827","nonce":96848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.202:6830","nonce":96848},{"type":"v1","addr":"172.21.15.202:6831","nonce":96848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.202:6828","nonce":96848},{"type":"v1","addr":"172.21.15.202:6829","nonce":96848}]},"public_addr":"172.21.15.202:6825/96848","cluster_addr":"172.21.15.202:6827/96848","heartbeat_back_addr":"172.21.15.202:6831/96848","heartbeat_front_addr":"172.21.15.202:6829/96848","state":["exists","up"]},{"osd":6,"uuid":"7bfc6dc0-2388-4498-9cd7-766e3606f6a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.202:6808","nonce":96845},{"type":"v1","addr":"172.21.15.202:6809","nonce":96845}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.202:6810","nonce":96845},{"type":"v1","addr":"172.21.15.202:6811","nonce":96845}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.202:6814","nonce":96845},{"type":"v1","addr":"172.21.15.202:6815","nonce":96845}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.202:6812","nonce":96845},{"type":"v1","addr":"172.21.15.202:6813","nonce":96845}]},"public_addr":"172.21.15.202:6809/96845","cluster_addr":"172.21.15.202:6811/96845","heartbeat_back_addr":"172.21.15.202:6815/96845","heartbeat_front_addr":"172.21.15.202:6813/96845","state":["exists","up"]},{"osd":7,"uuid":"c475f863-96fd-48e3-8033-7d1c3b1d503f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.202:6800","nonce":96846},{"type":"v1","addr":"172.21.15.202:6801","nonce":96846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.202:6802","nonce":96846},{"type":"v1","addr":"172.21.15.202:6803","nonce":96846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.202:6806","nonce":96846},{"type":"v1","addr":"172.21.15.202:6807","nonce":96846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.202:6804","nonce":96846},{"type":"v1","addr":"172.21.15.202:6805","nonce":96846}]},"public_addr":"172.21.15.202:6801/96846","cluster_addr":"172.21.15.202:6803/96846","heartbeat_back_addr":"172.21.15.202:6807/96846","heartbeat_front_addr":"172.21.15.202:6805/96846","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-06T13:48:55.997991+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-06T13:48:55.930805+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-06T13:48:56.000312+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-06T13:48:55.998360+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-06T13:48:56.052762+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-06T13:48:56.036049+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-06T13:48:56.048751+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-06T13:48:56.011928+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-03-06T13:49:10.025 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:10.024+0000 7f0707aea700 1 -- 172.21.15.86:0/1119258917 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7f06e40682f0 msgr2=0x7f06e406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:10.026 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:10.025+0000 7f0707aea700 1 --2- 172.21.15.86:0/1119258917 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7f06e40682f0 0x7f06e406a7a0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f06f00090b0 tx=0x7f06f0008030 comp rx=0 tx=0).stop 2023-03-06T13:49:10.026 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:10.025+0000 7f0707aea700 1 -- 172.21.15.86:0/1119258917 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0700145d50 msgr2=0x7f07001461a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:10.026 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:10.025+0000 7f0707aea700 1 --2- 172.21.15.86:0/1119258917 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0700145d50 0x7f07001461a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f06fc00eaa0 tx=0x7f06fc00ee60 comp rx=0 tx=0).stop 2023-03-06T13:49:10.026 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:10.025+0000 7f0707aea700 1 -- 172.21.15.86:0/1119258917 shutdown_connections 2023-03-06T13:49:10.026 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:10.025+0000 7f0707aea700 1 --2- 172.21.15.86:0/1119258917 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7f06e40682f0 0x7f06e406a7a0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:10.026 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:10.025+0000 7f0707aea700 1 --2- 172.21.15.86:0/1119258917 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f0700147e10 0x7f0700148280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:10.026 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:10.025+0000 7f0707aea700 1 --2- 172.21.15.86:0/1119258917 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f06ec003a70 0x7f07001494f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:10.027 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:10.025+0000 7f0707aea700 1 --2- 172.21.15.86:0/1119258917 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0700145d50 0x7f07001461a0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:10.027 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:10.025+0000 7f0707aea700 1 -- 172.21.15.86:0/1119258917 >> 172.21.15.86:0/1119258917 conn(0x7f070006af80 msgr2=0x7f07000c1440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T13:49:10.027 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:10.025+0000 7f0707aea700 1 -- 172.21.15.86:0/1119258917 shutdown_connections 2023-03-06T13:49:10.027 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:10.025+0000 7f0707aea700 1 -- 172.21.15.86:0/1119258917 wait complete. 2023-03-06T13:49:10.038 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-03-06T13:48:59.879087+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-03-06T13:49:06.686394+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-03-06T13:49:10.038 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-03-06T13:49:10.160 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:10.159+0000 7efca33ab700 1 Processor -- start 2023-03-06T13:49:10.160 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:10.159+0000 7efca33ab700 1 -- start start 2023-03-06T13:49:10.166 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:10.160+0000 7efca33ab700 1 --2- >> v2:172.21.15.202:3300/0 conn(0x7efc9c06ea90 0x7efc9c14f0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:10.166 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:10.160+0000 7efca33ab700 1 --2- >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7efc9c14f600 0x7efc9c159a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:10.167 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:10.160+0000 7efca33ab700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc9c153340 con 0x7efc9c149420 2023-03-06T13:49:10.167 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:10.160+0000 7efca33ab700 1 -- --> v2:172.21.15.202:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc9c1497f0 con 0x7efc9c06ea90 2023-03-06T13:49:10.167 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:10.160+0000 7efca33ab700 1 -- --> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc9c152750 con 0x7efc9c14f600 2023-03-06T13:49:10.167 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:10.160+0000 7efca1147700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7efc9c149420 0x7efc9c0c2860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:48612/0 (socket says 172.21.15.86:48612) 2023-03-06T13:49:10.168 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:10.160+0000 7efca1147700 1 -- 172.21.15.86:0/908059040 learned_addr learned my addr 172.21.15.86:0/908059040 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-03-06T13:49:10.168 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:10.160+0000 7efca1948700 1 --2- 172.21.15.86:0/908059040 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7efc9c14f600 0x7efc9c159a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:10.168 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:10.160+0000 7efca0946700 1 --2- 172.21.15.86:0/908059040 >> v2:172.21.15.202:3300/0 conn(0x7efc9c06ea90 0x7efc9c14f0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:10.168 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:10.160+0000 7efc93fff700 1 -- 172.21.15.86:0/908059040 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 460021587 0 0) 0x7efc9c153340 con 0x7efc9c149420 2023-03-06T13:49:10.169 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:10.160+0000 7efc93fff700 1 -- 172.21.15.86:0/908059040 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efc880035b0 con 0x7efc9c149420 2023-03-06T13:49:10.169 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:10.160+0000 7efc93fff700 1 -- 172.21.15.86:0/908059040 <== mon.0 v1:172.21.15.86:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3642607653 0 0) 0x7efc880035b0 con 0x7efc9c149420 2023-03-06T13:49:10.169 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:10.160+0000 7efc93fff700 1 -- 172.21.15.86:0/908059040 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7efc9c14f600 msgr2=0x7efc9c159a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T13:49:10.170 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:10.160+0000 7efc93fff700 1 --2- 172.21.15.86:0/908059040 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7efc9c14f600 0x7efc9c159a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:10.170 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:10.160+0000 7efc93fff700 1 -- 172.21.15.86:0/908059040 >> v2:172.21.15.202:3300/0 conn(0x7efc9c06ea90 msgr2=0x7efc9c14f0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T13:49:10.170 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:10.160+0000 7efc93fff700 1 --2- 172.21.15.86:0/908059040 >> v2:172.21.15.202:3300/0 conn(0x7efc9c06ea90 0x7efc9c14f0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:10.170 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:10.160+0000 7efc93fff700 1 -- 172.21.15.86:0/908059040 --> v1:172.21.15.86:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc9c152a10 con 0x7efc9c149420 2023-03-06T13:49:10.171 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:10.160+0000 7efc93fff700 1 -- 172.21.15.86:0/908059040 <== mon.0 v1:172.21.15.86:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2191261126 0 0) 0x7efc8c001670 con 0x7efc9c149420 2023-03-06T13:49:10.171 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:10.160+0000 7efc93fff700 1 -- 172.21.15.86:0/908059040 >> v1:172.21.15.86:6789/0 conn(0x7efc9c149420 legacy=0x7efc9c0c2860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:10.171 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:10.161+0000 7efc93fff700 1 --2- 172.21.15.86:0/908059040 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7efc88003a00 0x7efc88003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:10.172 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:10.161+0000 7efc93fff700 1 --2- 172.21.15.86:0/908059040 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efc88004850 0x7efc88004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:10.172 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:10.161+0000 7efc93fff700 1 --2- 172.21.15.86:0/908059040 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7efc88005200 0x7efc8800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:10.172 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:10.161+0000 7efc93fff700 1 -- 172.21.15.86:0/908059040 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc9c1497f0 con 0x7efc88004850 2023-03-06T13:49:10.172 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:10.161+0000 7efc93fff700 1 -- 172.21.15.86:0/908059040 --> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc9c152750 con 0x7efc88005200 2023-03-06T13:49:10.173 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:10.161+0000 7efc93fff700 1 -- 172.21.15.86:0/908059040 --> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc8800bfd0 con 0x7efc88003a00 2023-03-06T13:49:10.173 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:10.161+0000 7efca0946700 1 --2- 172.21.15.86:0/908059040 >> v2:172.21.15.202:3300/0 conn(0x7efc9c06ea90 0x7efc9c14f0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-06T13:49:10.173 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:10.161+0000 7efca1948700 1 --2- 172.21.15.86:0/908059040 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7efc9c14f600 0x7efc9c159a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-06T13:49:10.173 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:10.161+0000 7efca0946700 1 --2- 172.21.15.86:0/908059040 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efc88004850 0x7efc88004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:10.174 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:10.161+0000 7efca1147700 1 --2- 172.21.15.86:0/908059040 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7efc88003a00 0x7efc88003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:10.174 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:10.161+0000 7efca1948700 1 --2- 172.21.15.86:0/908059040 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7efc88005200 0x7efc8800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:10.174 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:10.161+0000 7efca0946700 1 -- 172.21.15.86:0/908059040 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7efc88003a00 msgr2=0x7efc88003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T13:49:10.174 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:10.161+0000 7efca0946700 1 --2- 172.21.15.86:0/908059040 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7efc88003a00 0x7efc88003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:10.175 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:10.161+0000 7efca0946700 1 -- 172.21.15.86:0/908059040 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7efc88005200 msgr2=0x7efc8800ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T13:49:10.175 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:10.161+0000 7efca0946700 1 --2- 172.21.15.86:0/908059040 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7efc88005200 0x7efc8800ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:10.175 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:10.161+0000 7efca0946700 1 -- 172.21.15.86:0/908059040 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc880035b0 con 0x7efc88004850 2023-03-06T13:49:10.175 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:10.161+0000 7efca1948700 1 --2- 172.21.15.86:0/908059040 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7efc88005200 0x7efc8800ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-06T13:49:10.176 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:10.161+0000 7efca0946700 1 --2- 172.21.15.86:0/908059040 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efc88004850 0x7efc88004cc0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7efc98009d10 tx=0x7efc88005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc3177ecd6ae5373 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T13:49:10.176 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:10.161+0000 7efc93fff700 1 -- 172.21.15.86:0/908059040 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc98009e60 con 0x7efc88004850 2023-03-06T13:49:10.176 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:10.161+0000 7efc93fff700 1 -- 172.21.15.86:0/908059040 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc9800e9a0 con 0x7efc88004850 2023-03-06T13:49:10.176 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:10.161+0000 7efc93fff700 1 -- 172.21.15.86:0/908059040 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc9800ed10 con 0x7efc88004850 2023-03-06T13:49:10.177 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:10.162+0000 7efca33ab700 1 -- 172.21.15.86:0/908059040 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efc88004850 msgr2=0x7efc88004cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:10.177 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:10.162+0000 7efca33ab700 1 --2- 172.21.15.86:0/908059040 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efc88004850 0x7efc88004cc0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7efc98009d10 tx=0x7efc88005880 comp rx=0 tx=0).stop 2023-03-06T13:49:10.177 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:10.162+0000 7efca1948700 1 -- 172.21.15.86:0/908059040 reap_dead start 2023-03-06T13:49:10.177 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:10.162+0000 7efca33ab700 1 -- 172.21.15.86:0/908059040 shutdown_connections 2023-03-06T13:49:10.178 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:10.162+0000 7efca33ab700 1 -- 172.21.15.86:0/908059040 >> 172.21.15.86:0/908059040 conn(0x7efc9c06c0d0 msgr2=0x7efc9c0c2150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T13:49:10.178 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:10.162+0000 7efca33ab700 1 -- 172.21.15.86:0/908059040 shutdown_connections 2023-03-06T13:49:10.178 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:10.162+0000 7efca33ab700 1 -- 172.21.15.86:0/908059040 wait complete. 2023-03-06T13:49:10.178 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:10.163+0000 7efca33ab700 1 Processor -- start 2023-03-06T13:49:10.179 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:10.163+0000 7efca33ab700 1 -- start start 2023-03-06T13:49:10.179 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:10.163+0000 7efca33ab700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efc88004850 0x7efc9c1d8750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:10.179 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:10.163+0000 7efca33ab700 1 --2- >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7efc9c14cfe0 0x7efc9c1e4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:10.179 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:10.163+0000 7efca33ab700 1 --2- >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7efc9c141610 0x7efc9c141a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:10.180 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:10.164+0000 7efca33ab700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc9c14dcd0 con 0x7efc88004850 2023-03-06T13:49:10.180 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:10.164+0000 7efca33ab700 1 -- --> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc9c1db8b0 con 0x7efc9c14cfe0 2023-03-06T13:49:10.180 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:10.164+0000 7efca33ab700 1 -- --> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc9c1d8c90 con 0x7efc9c141610 2023-03-06T13:49:10.180 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:10.164+0000 7efca1147700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efc88004850 0x7efc9c1d8750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:10.181 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:10.164+0000 7efca1147700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efc88004850 0x7efc9c1d8750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:38476/0 (socket says 172.21.15.86:38476) 2023-03-06T13:49:10.181 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:10.164+0000 7efca1147700 1 -- 172.21.15.86:0/4155937796 learned_addr learned my addr 172.21.15.86:0/4155937796 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-03-06T13:49:10.181 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:10.164+0000 7efca1948700 1 --2- 172.21.15.86:0/4155937796 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7efc9c141610 0x7efc9c141a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:10.181 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:10.164+0000 7efca0946700 1 --2- 172.21.15.86:0/4155937796 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7efc9c14cfe0 0x7efc9c1e4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:10.181 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:10.164+0000 7efca1147700 1 -- 172.21.15.86:0/4155937796 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7efc9c141610 msgr2=0x7efc9c141a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:10.182 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:10.164+0000 7efca1147700 1 --2- 172.21.15.86:0/4155937796 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7efc9c141610 0x7efc9c141a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:10.182 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:10.164+0000 7efca1147700 1 -- 172.21.15.86:0/4155937796 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7efc9c14cfe0 msgr2=0x7efc9c1e4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:10.182 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:10.164+0000 7efca1147700 1 --2- 172.21.15.86:0/4155937796 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7efc9c14cfe0 0x7efc9c1e4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:10.182 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:10.164+0000 7efca1147700 1 -- 172.21.15.86:0/4155937796 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc9c152fd0 con 0x7efc88004850 2023-03-06T13:49:10.182 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:10.164+0000 7efca0946700 1 --2- 172.21.15.86:0/4155937796 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7efc9c14cfe0 0x7efc9c1e4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-06T13:49:10.182 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:10.164+0000 7efca1147700 1 --2- 172.21.15.86:0/4155937796 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efc88004850 0x7efc9c1d8750 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7efc8c007370 tx=0x7efc8c007680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T13:49:10.182 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:10.164+0000 7efc91ffb700 1 -- 172.21.15.86:0/4155937796 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc8c0077a0 con 0x7efc88004850 2023-03-06T13:49:10.183 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:10.164+0000 7efc91ffb700 1 -- 172.21.15.86:0/4155937796 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc8c00f870 con 0x7efc88004850 2023-03-06T13:49:10.183 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:10.164+0000 7efca33ab700 1 -- 172.21.15.86:0/4155937796 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc9c152cf0 con 0x7efc88004850 2023-03-06T13:49:10.183 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:10.164+0000 7efc91ffb700 1 -- 172.21.15.86:0/4155937796 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc8c00fc20 con 0x7efc88004850 2023-03-06T13:49:10.183 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:10.164+0000 7efca33ab700 1 -- 172.21.15.86:0/4155937796 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc9c06e610 con 0x7efc88004850 2023-03-06T13:49:10.183 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:10.165+0000 7efca33ab700 1 -- 172.21.15.86:0/4155937796 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc9c14ce30 con 0x7efc88004850 2023-03-06T13:49:10.184 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:10.166+0000 7efc91ffb700 1 -- 172.21.15.86:0/4155937796 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7efc8c00fd80 con 0x7efc88004850 2023-03-06T13:49:10.184 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:10.166+0000 7efc91ffb700 1 --2- 172.21.15.86:0/4155937796 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7efc800682f0 0x7efc8006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:10.184 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:10.166+0000 7efc91ffb700 1 -- 172.21.15.86:0/4155937796 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5210+0+0 (secure 0 0 0) 0x7efc8c085080 con 0x7efc88004850 2023-03-06T13:49:10.185 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:10.166+0000 7efca0946700 1 --2- 172.21.15.86:0/4155937796 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7efc800682f0 0x7efc8006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:10.185 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:10.167+0000 7efca0946700 1 --2- 172.21.15.86:0/4155937796 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7efc800682f0 0x7efc8006a7a0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7efc9c0b8c20 tx=0x7efc98008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T13:49:10.185 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:10.170+0000 7efc91ffb700 1 -- 172.21.15.86:0/4155937796 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7efc8c051c90 con 0x7efc88004850 2023-03-06T13:49:10.352 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:10.351+0000 7efca33ab700 1 -- 172.21.15.86:0/4155937796 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7efc9c04e750 con 0x7efc88004850 2023-03-06T13:49:10.353 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:10.351+0000 7efc91ffb700 1 -- 172.21.15.86:0/4155937796 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v19) v1 ==== 93+0+10 (secure 0 0 0) 0x7efc8c0552b0 con 0x7efc88004850 2023-03-06T13:49:10.353 INFO:teuthology.orchestra.run.smithi086.stdout:pg_num: 1 2023-03-06T13:49:10.355 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:10.353+0000 7efca33ab700 1 -- 172.21.15.86:0/4155937796 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7efc800682f0 msgr2=0x7efc8006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:10.355 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:10.353+0000 7efca33ab700 1 --2- 172.21.15.86:0/4155937796 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7efc800682f0 0x7efc8006a7a0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7efc9c0b8c20 tx=0x7efc98008030 comp rx=0 tx=0).stop 2023-03-06T13:49:10.355 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:10.353+0000 7efca33ab700 1 -- 172.21.15.86:0/4155937796 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efc88004850 msgr2=0x7efc9c1d8750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:10.355 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:10.353+0000 7efca33ab700 1 --2- 172.21.15.86:0/4155937796 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efc88004850 0x7efc9c1d8750 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7efc8c007370 tx=0x7efc8c007680 comp rx=0 tx=0).stop 2023-03-06T13:49:10.356 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:10.353+0000 7efca33ab700 1 -- 172.21.15.86:0/4155937796 shutdown_connections 2023-03-06T13:49:10.356 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:10.353+0000 7efca33ab700 1 --2- 172.21.15.86:0/4155937796 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7efc800682f0 0x7efc8006a7a0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:10.356 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:10.353+0000 7efca33ab700 1 --2- 172.21.15.86:0/4155937796 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efc88004850 0x7efc9c1d8750 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:10.356 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:10.353+0000 7efca33ab700 1 --2- 172.21.15.86:0/4155937796 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7efc9c141610 0x7efc9c141a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:10.356 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:10.353+0000 7efca33ab700 1 --2- 172.21.15.86:0/4155937796 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7efc9c14cfe0 0x7efc9c1e4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:10.356 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:10.353+0000 7efca33ab700 1 -- 172.21.15.86:0/4155937796 >> 172.21.15.86:0/4155937796 conn(0x7efc9c06c0d0 msgr2=0x7efc9c0b79a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T13:49:10.356 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:10.353+0000 7efca33ab700 1 -- 172.21.15.86:0/4155937796 shutdown_connections 2023-03-06T13:49:10.357 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:10.353+0000 7efca33ab700 1 -- 172.21.15.86:0/4155937796 wait complete. 2023-03-06T13:49:10.366 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-03-06T13:49:10.489 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:10.488+0000 7f0ffe41b700 1 Processor -- start 2023-03-06T13:49:10.489 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:10.488+0000 7f0ffe41b700 1 -- start start 2023-03-06T13:49:10.491 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:10.489+0000 7f0ffe41b700 1 --2- >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f0ff8147030 0x7f0ff814d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:10.491 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:10.489+0000 7f0ffe41b700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ff8072500 con 0x7f0ff80bddc0 2023-03-06T13:49:10.492 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:10.489+0000 7f0ffe41b700 1 -- --> v1:172.21.15.202:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ff80ba280 con 0x7f0ff80b9da0 2023-03-06T13:49:10.492 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:10.489+0000 7f0ffe41b700 1 -- --> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ff80b8820 con 0x7f0ff8147030 2023-03-06T13:49:10.492 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:10.489+0000 7f0ff77fe700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f0ff80bddc0 0x7f0ff80b9690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:48632/0 (socket says 172.21.15.86:48632) 2023-03-06T13:49:10.492 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:10.489+0000 7f0ff77fe700 1 -- 172.21.15.86:0/2174057541 learned_addr learned my addr 172.21.15.86:0/2174057541 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-03-06T13:49:10.492 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:10.489+0000 7f0ff7fff700 1 --2- 172.21.15.86:0/2174057541 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f0ff8147030 0x7f0ff814d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:10.492 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:10.489+0000 7f0ff6ffd700 1 -- 172.21.15.86:0/2174057541 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3538495293 0 0) 0x7f0ff8072500 con 0x7f0ff80bddc0 2023-03-06T13:49:10.492 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:10.489+0000 7f0ff6ffd700 1 -- 172.21.15.86:0/2174057541 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0fe00035b0 con 0x7f0ff80bddc0 2023-03-06T13:49:10.492 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:10.489+0000 7f0ff6ffd700 1 -- 172.21.15.86:0/2174057541 <== mon.1 v1:172.21.15.202:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2636338113 0 0) 0x7f0ff80ba280 con 0x7f0ff80b9da0 2023-03-06T13:49:10.493 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:10.489+0000 7f0ff6ffd700 1 -- 172.21.15.86:0/2174057541 --> v1:172.21.15.202:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0ff8072500 con 0x7f0ff80b9da0 2023-03-06T13:49:10.493 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:10.489+0000 7f0ff6ffd700 1 -- 172.21.15.86:0/2174057541 <== mon.0 v1:172.21.15.86:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 604201146 0 0) 0x7f0fe00035b0 con 0x7f0ff80bddc0 2023-03-06T13:49:10.493 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:10.489+0000 7f0ff7fff700 1 -- 172.21.15.86:0/2174057541 >> v1:172.21.15.202:6789/0 conn(0x7f0ff80b9da0 legacy=0x7f0ff8157810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:10.493 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:10.489+0000 7f0ff7fff700 1 -- 172.21.15.86:0/2174057541 >> v1:172.21.15.86:6789/0 conn(0x7f0ff80bddc0 legacy=0x7f0ff80b9690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:10.493 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:10.489+0000 7f0ff7fff700 1 -- 172.21.15.86:0/2174057541 --> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ff8072220 con 0x7f0ff8147030 2023-03-06T13:49:10.493 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:10.489+0000 7f0ff7fff700 1 --2- 172.21.15.86:0/2174057541 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f0ff8147030 0x7f0ff814d7a0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f0fe8009870 tx=0x7f0fe8009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bee9dec5dc9c8841 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T13:49:10.493 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:10.490+0000 7f0ff6ffd700 1 -- 172.21.15.86:0/2174057541 <== mon.2 v2:172.21.15.202:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fec001670 con 0x7f0ff8147030 2023-03-06T13:49:10.494 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:10.490+0000 7f0ff6ffd700 1 -- 172.21.15.86:0/2174057541 <== mon.2 v2:172.21.15.202:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fe8004030 con 0x7f0ff8147030 2023-03-06T13:49:10.494 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:10.490+0000 7f0ff6ffd700 1 -- 172.21.15.86:0/2174057541 <== mon.2 v2:172.21.15.202:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fe80043c0 con 0x7f0ff8147030 2023-03-06T13:49:10.494 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:10.490+0000 7f0ffe41b700 1 -- 172.21.15.86:0/2174057541 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f0ff8147030 msgr2=0x7f0ff814d7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:10.494 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:10.490+0000 7f0ffe41b700 1 --2- 172.21.15.86:0/2174057541 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f0ff8147030 0x7f0ff814d7a0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f0fe8009870 tx=0x7f0fe8009b80 comp rx=0 tx=0).stop 2023-03-06T13:49:10.494 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:10.490+0000 7f0ffe41b700 1 -- 172.21.15.86:0/2174057541 shutdown_connections 2023-03-06T13:49:10.494 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:10.490+0000 7f0ffe41b700 1 --2- 172.21.15.86:0/2174057541 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f0ff8147030 0x7f0ff814d7a0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:10.494 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:10.490+0000 7f0ffe41b700 1 -- 172.21.15.86:0/2174057541 >> 172.21.15.86:0/2174057541 conn(0x7f0ff80c3230 msgr2=0x7f0ff80c3630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T13:49:10.495 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:10.490+0000 7f0ffe41b700 1 -- 172.21.15.86:0/2174057541 shutdown_connections 2023-03-06T13:49:10.495 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:10.490+0000 7f0ffe41b700 1 -- 172.21.15.86:0/2174057541 wait complete. 2023-03-06T13:49:10.497 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:10.491+0000 7f0ffe41b700 1 Processor -- start 2023-03-06T13:49:10.497 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:10.491+0000 7f0ffe41b700 1 -- start start 2023-03-06T13:49:10.497 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:10.492+0000 7f0ffe41b700 1 --2- >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f0ff80b9da0 0x7f0ff814c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:10.497 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:10.492+0000 7f0ffe41b700 1 --2- >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f0ff80bddc0 0x7f0ff80c1b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:10.497 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:10.492+0000 7f0ffe41b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0ff8147030 0x7f0ff8144370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:10.498 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:10.492+0000 7f0ffe41b700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ff80c2c50 con 0x7f0ff8147030 2023-03-06T13:49:10.498 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:10.492+0000 7f0ffe41b700 1 -- --> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ff814c880 con 0x7f0ff80bddc0 2023-03-06T13:49:10.498 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:10.492+0000 7f0ffe41b700 1 -- --> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ff814df00 con 0x7f0ff80b9da0 2023-03-06T13:49:10.498 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:10.492+0000 7f0ff7fff700 1 --2- >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f0ff80b9da0 0x7f0ff814c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:10.498 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:10.492+0000 7f0ffc9b8700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0ff8147030 0x7f0ff8144370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:10.498 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:10.492+0000 7f0ff7fff700 1 --2- >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f0ff80b9da0 0x7f0ff814c340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.202:3301/0 says I am v2:172.21.15.86:50184/0 (socket says 172.21.15.86:50184) 2023-03-06T13:49:10.498 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:10.492+0000 7f0ff77fe700 1 --2- >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f0ff80bddc0 0x7f0ff80c1b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:10.499 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:10.492+0000 7f0ff7fff700 1 -- 172.21.15.86:0/3062715671 learned_addr learned my addr 172.21.15.86:0/3062715671 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-03-06T13:49:10.499 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:10.493+0000 7f0ffc9b8700 1 -- 172.21.15.86:0/3062715671 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f0ff80b9da0 msgr2=0x7f0ff814c340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:10.499 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:10.493+0000 7f0ffc9b8700 1 --2- 172.21.15.86:0/3062715671 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f0ff80b9da0 0x7f0ff814c340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:10.499 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:10.493+0000 7f0ffc9b8700 1 -- 172.21.15.86:0/3062715671 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f0ff80bddc0 msgr2=0x7f0ff80c1b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:10.499 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:10.493+0000 7f0ffc9b8700 1 --2- 172.21.15.86:0/3062715671 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f0ff80bddc0 0x7f0ff80c1b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:10.499 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:10.493+0000 7f0ffc9b8700 1 -- 172.21.15.86:0/3062715671 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fe80094a0 con 0x7f0ff8147030 2023-03-06T13:49:10.499 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:10.493+0000 7f0ffc9b8700 1 --2- 172.21.15.86:0/3062715671 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0ff8147030 0x7f0ff8144370 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f0ff000cbc0 tx=0x7f0ff000ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T13:49:10.499 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:10.493+0000 7f0ff4ff9700 1 -- 172.21.15.86:0/3062715671 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ff0003c00 con 0x7f0ff8147030 2023-03-06T13:49:10.500 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:10.493+0000 7f0ff4ff9700 1 -- 172.21.15.86:0/3062715671 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ff0003d60 con 0x7f0ff8147030 2023-03-06T13:49:10.500 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:10.493+0000 7f0ffe41b700 1 -- 172.21.15.86:0/3062715671 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ff814d280 con 0x7f0ff8147030 2023-03-06T13:49:10.500 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:10.493+0000 7f0ff4ff9700 1 -- 172.21.15.86:0/3062715671 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ff000aa80 con 0x7f0ff8147030 2023-03-06T13:49:10.500 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:10.493+0000 7f0ffe41b700 1 -- 172.21.15.86:0/3062715671 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ff814cfa0 con 0x7f0ff8147030 2023-03-06T13:49:10.500 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:10.494+0000 7f0ffe41b700 1 -- 172.21.15.86:0/3062715671 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ff8070020 con 0x7f0ff8147030 2023-03-06T13:49:10.500 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:10.494+0000 7f0ff4ff9700 1 -- 172.21.15.86:0/3062715671 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f0ff0010050 con 0x7f0ff8147030 2023-03-06T13:49:10.500 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:10.494+0000 7f0ff4ff9700 1 --2- 172.21.15.86:0/3062715671 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7f0fe40682f0 0x7f0fe406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:10.500 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:10.495+0000 7f0ff4ff9700 1 -- 172.21.15.86:0/3062715671 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f0ff0085810 con 0x7f0ff8147030 2023-03-06T13:49:10.501 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:10.495+0000 7f0ff7fff700 1 --2- 172.21.15.86:0/3062715671 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7f0fe40682f0 0x7f0fe406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:10.501 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:10.495+0000 7f0ff7fff700 1 --2- 172.21.15.86:0/3062715671 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7f0fe40682f0 0x7f0fe406a7a0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f0fe8009bc0 tx=0x7f0fe8008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T13:49:10.501 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:10.499+0000 7f0ff4ff9700 1 -- 172.21.15.86:0/3062715671 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f0ff0052340 con 0x7f0ff8147030 2023-03-06T13:49:10.682 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:10.681+0000 7f0ffe41b700 1 -- 172.21.15.86:0/3062715671 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f0ff80bf4b0 con 0x7f0ff8147030 2023-03-06T13:49:10.683 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:10.681+0000 7f0ff4ff9700 1 -- 172.21.15.86:0/3062715671 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v19) v1 ==== 92+0+10 (secure 0 0 0) 0x7f0ff0055960 con 0x7f0ff8147030 2023-03-06T13:49:10.683 INFO:teuthology.orchestra.run.smithi086.stdout:pg_num: 8 2023-03-06T13:49:10.685 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:10.683+0000 7f0ffe41b700 1 -- 172.21.15.86:0/3062715671 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7f0fe40682f0 msgr2=0x7f0fe406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:10.685 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:10.683+0000 7f0ffe41b700 1 --2- 172.21.15.86:0/3062715671 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7f0fe40682f0 0x7f0fe406a7a0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f0fe8009bc0 tx=0x7f0fe8008030 comp rx=0 tx=0).stop 2023-03-06T13:49:10.686 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:10.683+0000 7f0ffe41b700 1 -- 172.21.15.86:0/3062715671 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0ff8147030 msgr2=0x7f0ff8144370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:10.686 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:10.683+0000 7f0ffe41b700 1 --2- 172.21.15.86:0/3062715671 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0ff8147030 0x7f0ff8144370 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f0ff000cbc0 tx=0x7f0ff000ced0 comp rx=0 tx=0).stop 2023-03-06T13:49:10.686 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:10.684+0000 7f0ffe41b700 1 -- 172.21.15.86:0/3062715671 shutdown_connections 2023-03-06T13:49:10.687 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:10.684+0000 7f0ffe41b700 1 --2- 172.21.15.86:0/3062715671 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7f0fe40682f0 0x7f0fe406a7a0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:10.688 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:10.684+0000 7f0ffe41b700 1 --2- 172.21.15.86:0/3062715671 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0ff8147030 0x7f0ff8144370 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:10.688 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:10.684+0000 7f0ffe41b700 1 --2- 172.21.15.86:0/3062715671 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f0ff80b9da0 0x7f0ff814c340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:10.688 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:10.684+0000 7f0ffe41b700 1 --2- 172.21.15.86:0/3062715671 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f0ff80bddc0 0x7f0ff80c1b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:10.689 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:10.684+0000 7f0ffe41b700 1 -- 172.21.15.86:0/3062715671 >> 172.21.15.86:0/3062715671 conn(0x7f0ff80c3230 msgr2=0x7f0ff80c3600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T13:49:10.689 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:10.684+0000 7f0ffe41b700 1 -- 172.21.15.86:0/3062715671 shutdown_connections 2023-03-06T13:49:10.689 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:10.684+0000 7f0ffe41b700 1 -- 172.21.15.86:0/3062715671 wait complete. 2023-03-06T13:49:10.697 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-03-06T13:49:10.817 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:10.816+0000 7fddc15e3700 1 Processor -- start 2023-03-06T13:49:10.818 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:10.817+0000 7fddc15e3700 1 -- start start 2023-03-06T13:49:10.819 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:10.817+0000 7fddc15e3700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fddbc06a610 0x7fddbc06aab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:10.820 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:10.817+0000 7fddc15e3700 1 --2- >> v2:172.21.15.202:3300/0 conn(0x7fddbc157b80 0x7fddbc159f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:10.820 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:10.817+0000 7fddc15e3700 1 -- --> v1:172.21.15.202:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fddbc0c08a0 con 0x7fddbc149760 2023-03-06T13:49:10.820 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:10.817+0000 7fddc15e3700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fddbc06b970 con 0x7fddbc06a610 2023-03-06T13:49:10.820 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:10.817+0000 7fddc15e3700 1 -- --> v2:172.21.15.202:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fddbc06b330 con 0x7fddbc157b80 2023-03-06T13:49:10.820 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:10.817+0000 7fddba7fc700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fddbc06a610 0x7fddbc06aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:10.820 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:10.817+0000 7fddba7fc700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fddbc06a610 0x7fddbc06aab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:38500/0 (socket says 172.21.15.86:38500) 2023-03-06T13:49:10.820 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:10.817+0000 7fddba7fc700 1 -- 172.21.15.86:0/1744721819 learned_addr learned my addr 172.21.15.86:0/1744721819 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-03-06T13:49:10.821 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:10.818+0000 7fddbb7fe700 1 --2- 172.21.15.86:0/1744721819 >> v2:172.21.15.202:3300/0 conn(0x7fddbc157b80 0x7fddbc159f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:10.821 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:10.818+0000 7fddba7fc700 1 -- 172.21.15.86:0/1744721819 >> v2:172.21.15.202:3300/0 conn(0x7fddbc157b80 msgr2=0x7fddbc159f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T13:49:10.821 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:10.818+0000 7fddba7fc700 1 --2- 172.21.15.86:0/1744721819 >> v2:172.21.15.202:3300/0 conn(0x7fddbc157b80 0x7fddbc159f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:10.821 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:10.818+0000 7fddba7fc700 1 -- 172.21.15.86:0/1744721819 >> v1:172.21.15.202:6789/0 conn(0x7fddbc149760 legacy=0x7fddbc0c2660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T13:49:10.821 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:10.818+0000 7fddba7fc700 1 -- 172.21.15.86:0/1744721819 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddbc0c1d50 con 0x7fddbc06a610 2023-03-06T13:49:10.821 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:10.818+0000 7fddba7fc700 1 --2- 172.21.15.86:0/1744721819 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fddbc06a610 0x7fddbc06aab0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fddac0098f0 tx=0x7fddac009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=522b7dbd01eb6a84 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T13:49:10.821 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:10.818+0000 7fddb9ffb700 1 -- 172.21.15.86:0/1744721819 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddac004230 con 0x7fddbc06a610 2023-03-06T13:49:10.822 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:10.818+0000 7fddb9ffb700 1 -- 172.21.15.86:0/1744721819 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddac004390 con 0x7fddbc06a610 2023-03-06T13:49:10.822 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:10.818+0000 7fddb9ffb700 1 -- 172.21.15.86:0/1744721819 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddac0036a0 con 0x7fddbc06a610 2023-03-06T13:49:10.822 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:10.818+0000 7fddc15e3700 1 -- 172.21.15.86:0/1744721819 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fddbc06a610 msgr2=0x7fddbc06aab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:10.822 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:10.818+0000 7fddc15e3700 1 --2- 172.21.15.86:0/1744721819 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fddbc06a610 0x7fddbc06aab0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fddac0098f0 tx=0x7fddac009c00 comp rx=0 tx=0).stop 2023-03-06T13:49:10.822 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:10.818+0000 7fddc15e3700 1 -- 172.21.15.86:0/1744721819 shutdown_connections 2023-03-06T13:49:10.822 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:10.818+0000 7fddc15e3700 1 --2- 172.21.15.86:0/1744721819 >> v2:172.21.15.202:3300/0 conn(0x7fddbc157b80 0x7fddbc159f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:10.822 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:10.818+0000 7fddc15e3700 1 --2- 172.21.15.86:0/1744721819 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fddbc06a610 0x7fddbc06aab0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:10.822 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:10.818+0000 7fddc15e3700 1 -- 172.21.15.86:0/1744721819 >> 172.21.15.86:0/1744721819 conn(0x7fddbc0c6160 msgr2=0x7fddbc0c1f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T13:49:10.823 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:10.818+0000 7fddc15e3700 1 -- 172.21.15.86:0/1744721819 shutdown_connections 2023-03-06T13:49:10.823 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:10.818+0000 7fddc15e3700 1 -- 172.21.15.86:0/1744721819 wait complete. 2023-03-06T13:49:10.825 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:10.820+0000 7fddc15e3700 1 Processor -- start 2023-03-06T13:49:10.825 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:10.820+0000 7fddc15e3700 1 -- start start 2023-03-06T13:49:10.825 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:10.820+0000 7fddc15e3700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fddbc06a610 0x7fddbc14bec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:10.825 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:10.820+0000 7fddc15e3700 1 --2- >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fddbc149760 0x7fddbc0aae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:10.826 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:10.820+0000 7fddc15e3700 1 --2- >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7fddbc157b80 0x7fddbc0b9dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:10.826 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:10.820+0000 7fddc15e3700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddbc0aaa70 con 0x7fddbc06a610 2023-03-06T13:49:10.826 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:10.820+0000 7fddc15e3700 1 -- --> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddbc14a770 con 0x7fddbc157b80 2023-03-06T13:49:10.826 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:10.820+0000 7fddc15e3700 1 -- --> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddbc0be980 con 0x7fddbc149760 2023-03-06T13:49:10.826 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:10.820+0000 7fddbaffd700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fddbc06a610 0x7fddbc14bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:10.826 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:10.820+0000 7fddbaffd700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fddbc06a610 0x7fddbc14bec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:38504/0 (socket says 172.21.15.86:38504) 2023-03-06T13:49:10.826 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:10.820+0000 7fddbaffd700 1 -- 172.21.15.86:0/3452563020 learned_addr learned my addr 172.21.15.86:0/3452563020 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-03-06T13:49:10.827 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:10.820+0000 7fddbb7fe700 1 --2- 172.21.15.86:0/3452563020 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7fddbc157b80 0x7fddbc0b9dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:10.827 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:10.820+0000 7fddba7fc700 1 --2- 172.21.15.86:0/3452563020 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fddbc149760 0x7fddbc0aae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:10.827 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:10.821+0000 7fddbaffd700 1 -- 172.21.15.86:0/3452563020 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fddbc149760 msgr2=0x7fddbc0aae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:10.827 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:10.821+0000 7fddbaffd700 1 --2- 172.21.15.86:0/3452563020 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fddbc149760 0x7fddbc0aae90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:10.827 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:10.821+0000 7fddbaffd700 1 -- 172.21.15.86:0/3452563020 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7fddbc157b80 msgr2=0x7fddbc0b9dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:10.827 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:10.821+0000 7fddbaffd700 1 --2- 172.21.15.86:0/3452563020 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7fddbc157b80 0x7fddbc0b9dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:10.827 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:10.821+0000 7fddbaffd700 1 -- 172.21.15.86:0/3452563020 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddac009550 con 0x7fddbc06a610 2023-03-06T13:49:10.827 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:10.821+0000 7fddba7fc700 1 --2- 172.21.15.86:0/3452563020 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fddbc149760 0x7fddbc0aae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-06T13:49:10.828 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:10.821+0000 7fddbaffd700 1 --2- 172.21.15.86:0/3452563020 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fddbc06a610 0x7fddbc14bec0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fddb000c4d0 tx=0x7fddb000c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T13:49:10.828 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:10.821+0000 7fdda37fe700 1 -- 172.21.15.86:0/3452563020 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddb0011790 con 0x7fddbc06a610 2023-03-06T13:49:10.828 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:10.821+0000 7fdda37fe700 1 -- 172.21.15.86:0/3452563020 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddb00118f0 con 0x7fddbc06a610 2023-03-06T13:49:10.828 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:10.821+0000 7fddc15e3700 1 -- 172.21.15.86:0/3452563020 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddbc0c01f0 con 0x7fddbc06a610 2023-03-06T13:49:10.828 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:10.821+0000 7fdda37fe700 1 -- 172.21.15.86:0/3452563020 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddb0011ca0 con 0x7fddbc06a610 2023-03-06T13:49:10.828 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:10.821+0000 7fddc15e3700 1 -- 172.21.15.86:0/3452563020 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddbc08b9c0 con 0x7fddbc06a610 2023-03-06T13:49:10.828 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:10.822+0000 7fddc15e3700 1 -- 172.21.15.86:0/3452563020 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fddbc0aa7e0 con 0x7fddbc06a610 2023-03-06T13:49:10.829 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:10.822+0000 7fdda37fe700 1 -- 172.21.15.86:0/3452563020 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fddb0010050 con 0x7fddbc06a610 2023-03-06T13:49:10.829 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:10.823+0000 7fdda37fe700 1 --2- 172.21.15.86:0/3452563020 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7fdda80682f0 0x7fdda806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:10.829 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:10.823+0000 7fdda37fe700 1 -- 172.21.15.86:0/3452563020 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fddb0085540 con 0x7fddbc06a610 2023-03-06T13:49:10.829 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:10.823+0000 7fddba7fc700 1 --2- 172.21.15.86:0/3452563020 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7fdda80682f0 0x7fdda806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:10.829 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:10.823+0000 7fddba7fc700 1 --2- 172.21.15.86:0/3452563020 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7fdda80682f0 0x7fdda806a7a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fddac009130 tx=0x7fddac008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T13:49:10.831 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:10.827+0000 7fdda37fe700 1 -- 172.21.15.86:0/3452563020 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fddb00520f0 con 0x7fddbc06a610 2023-03-06T13:49:11.013 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:11.012+0000 7fddc15e3700 1 -- 172.21.15.86:0/3452563020 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fddbc0c19e0 con 0x7fddbc06a610 2023-03-06T13:49:11.014 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:11.013+0000 7fdda37fe700 1 -- 172.21.15.86:0/3452563020 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v19) v1 ==== 84+0+126 (secure 0 0 0) 0x7fddb0055710 con 0x7fddbc06a610 2023-03-06T13:49:11.017 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-03-06T13:49:11.017 INFO:teuthology.orchestra.run.smithi086.stdout:[ 2023-03-06T13:49:11.017 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-03-06T13:49:11.017 INFO:teuthology.orchestra.run.smithi086.stdout: "poolnum": 1, 2023-03-06T13:49:11.017 INFO:teuthology.orchestra.run.smithi086.stdout: "poolname": ".mgr" 2023-03-06T13:49:11.018 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-03-06T13:49:11.018 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-03-06T13:49:11.019 INFO:teuthology.orchestra.run.smithi086.stdout: "poolnum": 2, 2023-03-06T13:49:11.019 INFO:teuthology.orchestra.run.smithi086.stdout: "poolname": "rbd" 2023-03-06T13:49:11.019 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-03-06T13:49:11.019 INFO:teuthology.orchestra.run.smithi086.stdout:] 2023-03-06T13:49:11.020 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:11.015+0000 7fddc15e3700 1 -- 172.21.15.86:0/3452563020 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7fdda80682f0 msgr2=0x7fdda806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:11.020 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:11.015+0000 7fddc15e3700 1 --2- 172.21.15.86:0/3452563020 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7fdda80682f0 0x7fdda806a7a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fddac009130 tx=0x7fddac008030 comp rx=0 tx=0).stop 2023-03-06T13:49:11.020 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:11.015+0000 7fddc15e3700 1 -- 172.21.15.86:0/3452563020 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fddbc06a610 msgr2=0x7fddbc14bec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:11.021 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:11.015+0000 7fddc15e3700 1 --2- 172.21.15.86:0/3452563020 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fddbc06a610 0x7fddbc14bec0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fddb000c4d0 tx=0x7fddb000c7e0 comp rx=0 tx=0).stop 2023-03-06T13:49:11.021 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:11.015+0000 7fddc15e3700 1 -- 172.21.15.86:0/3452563020 shutdown_connections 2023-03-06T13:49:11.021 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:11.015+0000 7fddc15e3700 1 --2- 172.21.15.86:0/3452563020 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7fdda80682f0 0x7fdda806a7a0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:11.021 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:11.015+0000 7fddc15e3700 1 --2- 172.21.15.86:0/3452563020 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fddbc06a610 0x7fddbc14bec0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:11.021 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:11.015+0000 7fddc15e3700 1 --2- 172.21.15.86:0/3452563020 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7fddbc157b80 0x7fddbc0b9dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:11.021 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:11.015+0000 7fddc15e3700 1 --2- 172.21.15.86:0/3452563020 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fddbc149760 0x7fddbc0aae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:11.021 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:11.015+0000 7fddc15e3700 1 -- 172.21.15.86:0/3452563020 >> 172.21.15.86:0/3452563020 conn(0x7fddbc0c6160 msgr2=0x7fddbc14e3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T13:49:11.022 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:11.015+0000 7fddc15e3700 1 -- 172.21.15.86:0/3452563020 shutdown_connections 2023-03-06T13:49:11.022 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:11.015+0000 7fddc15e3700 1 -- 172.21.15.86:0/3452563020 wait complete. 2023-03-06T13:49:11.028 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-03-06T13:49:11.028 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-03-06T13:49:11.152 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:11.151+0000 7fecbb91c700 1 Processor -- start 2023-03-06T13:49:11.152 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:11.151+0000 7fecbb91c700 1 -- start start 2023-03-06T13:49:11.153 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:11.152+0000 7fecbb91c700 1 --2- >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fecb40c0d40 0x7fecb414faf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:11.154 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:11.152+0000 7fecbb91c700 1 --2- >> v2:172.21.15.202:3300/0 conn(0x7fecb4150030 0x7fecb406d970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:11.154 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:11.152+0000 7fecbb91c700 1 -- --> v1:172.21.15.202:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fecb40bcb70 con 0x7fecb406deb0 2023-03-06T13:49:11.154 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:11.152+0000 7fecbb91c700 1 -- --> v2:172.21.15.202:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fecb414f6d0 con 0x7fecb4150030 2023-03-06T13:49:11.154 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:11.152+0000 7fecbb91c700 1 -- --> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecb406b7e0 con 0x7fecb40c0d40 2023-03-06T13:49:11.154 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:11.152+0000 7fecb96b8700 1 --2- >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fecb40c0d40 0x7fecb414faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:11.154 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:11.153+0000 7fecb96b8700 1 --2- >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fecb40c0d40 0x7fecb414faf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.202:3301/0 says I am v2:172.21.15.86:50206/0 (socket says 172.21.15.86:50206) 2023-03-06T13:49:11.155 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:11.153+0000 7fecb8eb7700 1 --2- >> v2:172.21.15.202:3300/0 conn(0x7fecb4150030 0x7fecb406d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:11.155 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:11.153+0000 7fecb96b8700 1 -- 172.21.15.86:0/1167954995 learned_addr learned my addr 172.21.15.86:0/1167954995 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-03-06T13:49:11.155 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:11.153+0000 7fecb9eb9700 1 --1- 172.21.15.86:0/1167954995 >> v1:172.21.15.202:6789/0 conn(0x7fecb406deb0 0x7fecb4152810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.202:6789/0 says I am v1:172.21.15.86:47720/0 (socket says 172.21.15.86:47720) 2023-03-06T13:49:11.155 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:11.153+0000 7fecb8eb7700 1 -- 172.21.15.86:0/1167954995 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fecb40c0d40 msgr2=0x7fecb414faf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T13:49:11.155 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:11.153+0000 7fecb8eb7700 1 --2- 172.21.15.86:0/1167954995 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fecb40c0d40 0x7fecb414faf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:11.155 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:11.153+0000 7fecb8eb7700 1 -- 172.21.15.86:0/1167954995 >> v1:172.21.15.202:6789/0 conn(0x7fecb406deb0 legacy=0x7fecb4152810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:11.155 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:11.153+0000 7fecb8eb7700 1 -- 172.21.15.86:0/1167954995 --> v2:172.21.15.202:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecb40c1110 con 0x7fecb4150030 2023-03-06T13:49:11.155 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:11.153+0000 7fecb96b8700 1 --2- 172.21.15.86:0/1167954995 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fecb40c0d40 0x7fecb414faf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-06T13:49:11.156 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:11.153+0000 7fecb8eb7700 1 --2- 172.21.15.86:0/1167954995 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7fecb4150030 0x7fecb406d970 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fecb0009840 tx=0x7fecb0009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=389415bda1ef4042 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T13:49:11.158 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:11.153+0000 7fecabfff700 1 -- 172.21.15.86:0/1167954995 <== mon.1 v2:172.21.15.202:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecb0011830 con 0x7fecb4150030 2023-03-06T13:49:11.158 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:11.153+0000 7fecabfff700 1 -- 172.21.15.86:0/1167954995 <== mon.1 v2:172.21.15.202:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecb0011990 con 0x7fecb4150030 2023-03-06T13:49:11.158 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:11.153+0000 7fecabfff700 1 -- 172.21.15.86:0/1167954995 <== mon.1 v2:172.21.15.202:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecb0011d20 con 0x7fecb4150030 2023-03-06T13:49:11.158 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:11.154+0000 7fecbb91c700 1 -- 172.21.15.86:0/1167954995 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7fecb4150030 msgr2=0x7fecb406d970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:11.159 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:11.154+0000 7fecbb91c700 1 --2- 172.21.15.86:0/1167954995 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7fecb4150030 0x7fecb406d970 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fecb0009840 tx=0x7fecb0009b50 comp rx=0 tx=0).stop 2023-03-06T13:49:11.159 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:11.154+0000 7fecbb91c700 1 -- 172.21.15.86:0/1167954995 shutdown_connections 2023-03-06T13:49:11.159 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:11.154+0000 7fecbb91c700 1 --2- 172.21.15.86:0/1167954995 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fecb40c0d40 0x7fecb414faf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:11.159 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:11.154+0000 7fecbb91c700 1 --2- 172.21.15.86:0/1167954995 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7fecb4150030 0x7fecb406d970 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:11.159 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:11.154+0000 7fecbb91c700 1 -- 172.21.15.86:0/1167954995 >> 172.21.15.86:0/1167954995 conn(0x7fecb40c1900 msgr2=0x7fecb40c1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T13:49:11.159 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:11.154+0000 7fecbb91c700 1 -- 172.21.15.86:0/1167954995 shutdown_connections 2023-03-06T13:49:11.159 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:11.154+0000 7fecbb91c700 1 -- 172.21.15.86:0/1167954995 wait complete. 2023-03-06T13:49:11.160 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:11.155+0000 7fecbb91c700 1 Processor -- start 2023-03-06T13:49:11.160 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:11.155+0000 7fecbb91c700 1 -- start start 2023-03-06T13:49:11.160 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:11.155+0000 7fecbb91c700 1 --2- >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fecb406deb0 0x7fecb40a4de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:11.160 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:11.156+0000 7fecbb91c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fecb40c0d40 0x7fecb40a5de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:11.160 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:11.156+0000 7fecbb91c700 1 --2- >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7fecb4150030 0x7fecb41d8cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:11.160 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:11.156+0000 7fecbb91c700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecb40a70d0 con 0x7fecb40c0d40 2023-03-06T13:49:11.160 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:11.156+0000 7fecbb91c700 1 -- --> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecb40a48b0 con 0x7fecb4150030 2023-03-06T13:49:11.160 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:11.156+0000 7fecbb91c700 1 -- --> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecb414d3d0 con 0x7fecb406deb0 2023-03-06T13:49:11.161 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:11.156+0000 7fecb8eb7700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fecb40c0d40 0x7fecb40a5de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:11.161 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:11.156+0000 7fecb8eb7700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fecb40c0d40 0x7fecb40a5de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:38520/0 (socket says 172.21.15.86:38520) 2023-03-06T13:49:11.161 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:11.156+0000 7fecb8eb7700 1 -- 172.21.15.86:0/1562936266 learned_addr learned my addr 172.21.15.86:0/1562936266 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-03-06T13:49:11.161 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:11.156+0000 7fecb96b8700 1 --2- 172.21.15.86:0/1562936266 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fecb406deb0 0x7fecb40a4de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:11.161 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:11.156+0000 7fecb9eb9700 1 --2- 172.21.15.86:0/1562936266 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7fecb4150030 0x7fecb41d8cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:11.161 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:11.156+0000 7fecb8eb7700 1 -- 172.21.15.86:0/1562936266 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fecb406deb0 msgr2=0x7fecb40a4de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:11.161 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:11.156+0000 7fecb8eb7700 1 --2- 172.21.15.86:0/1562936266 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fecb406deb0 0x7fecb40a4de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:11.162 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:11.156+0000 7fecb8eb7700 1 -- 172.21.15.86:0/1562936266 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7fecb4150030 msgr2=0x7fecb41d8cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:11.162 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:11.156+0000 7fecb8eb7700 1 --2- 172.21.15.86:0/1562936266 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7fecb4150030 0x7fecb41d8cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:11.162 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:11.156+0000 7fecb8eb7700 1 -- 172.21.15.86:0/1562936266 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feca4009550 con 0x7fecb40c0d40 2023-03-06T13:49:11.162 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:11.156+0000 7fecb8eb7700 1 --2- 172.21.15.86:0/1562936266 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fecb40c0d40 0x7fecb40a5de0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fecb0009fd0 tx=0x7fecb0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T13:49:11.162 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:11.156+0000 7feca9ffb700 1 -- 172.21.15.86:0/1562936266 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecb00036a0 con 0x7fecb40c0d40 2023-03-06T13:49:11.162 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:11.156+0000 7feca9ffb700 1 -- 172.21.15.86:0/1562936266 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecb001e070 con 0x7fecb40c0d40 2023-03-06T13:49:11.162 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:11.156+0000 7fecbb91c700 1 -- 172.21.15.86:0/1562936266 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fecb00094a0 con 0x7fecb40c0d40 2023-03-06T13:49:11.162 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:11.156+0000 7feca9ffb700 1 -- 172.21.15.86:0/1562936266 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecb0003a60 con 0x7fecb40c0d40 2023-03-06T13:49:11.163 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:11.157+0000 7fecbb91c700 1 -- 172.21.15.86:0/1562936266 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fecb40bd5e0 con 0x7fecb40c0d40 2023-03-06T13:49:11.163 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:11.157+0000 7fecbb91c700 1 -- 172.21.15.86:0/1562936266 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fecb40bd300 con 0x7fecb40c0d40 2023-03-06T13:49:11.163 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:11.158+0000 7feca9ffb700 1 -- 172.21.15.86:0/1562936266 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fecb000f050 con 0x7fecb40c0d40 2023-03-06T13:49:11.164 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:11.158+0000 7feca9ffb700 1 --2- 172.21.15.86:0/1562936266 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7fec980682f0 0x7fec9806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:11.164 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:11.158+0000 7feca9ffb700 1 -- 172.21.15.86:0/1562936266 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fecb0086960 con 0x7fecb40c0d40 2023-03-06T13:49:11.164 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:11.158+0000 7fecb96b8700 1 --2- 172.21.15.86:0/1562936266 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7fec980682f0 0x7fec9806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:11.164 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:11.158+0000 7fecb96b8700 1 --2- 172.21.15.86:0/1562936266 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7fec980682f0 0x7fec9806a7a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7feca4009cf0 tx=0x7feca4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T13:49:11.164 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:11.162+0000 7feca9ffb700 1 -- 172.21.15.86:0/1562936266 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fecb0053510 con 0x7fecb40c0d40 2023-03-06T13:49:11.346 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:11.345+0000 7fecbb91c700 1 -- 172.21.15.86:0/1562936266 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fecb40bd8c0 con 0x7fecb40c0d40 2023-03-06T13:49:12.293 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T13:49:12.296 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T13:49:12.314 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:12.313+0000 7feca9ffb700 1 -- 172.21.15.86:0/1562936266 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v20) v1 ==== 138+0+0 (secure 0 0 0) 0x7fecb0015020 con 0x7fecb40c0d40 2023-03-06T13:49:12.319 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:12.318+0000 7fecbb91c700 1 -- 172.21.15.86:0/1562936266 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7fec980682f0 msgr2=0x7fec9806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:12.319 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:12.318+0000 7fecbb91c700 1 --2- 172.21.15.86:0/1562936266 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7fec980682f0 0x7fec9806a7a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7feca4009cf0 tx=0x7feca4008040 comp rx=0 tx=0).stop 2023-03-06T13:49:12.320 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:12.318+0000 7fecbb91c700 1 -- 172.21.15.86:0/1562936266 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fecb40c0d40 msgr2=0x7fecb40a5de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:12.320 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:12.318+0000 7fecbb91c700 1 --2- 172.21.15.86:0/1562936266 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fecb40c0d40 0x7fecb40a5de0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fecb0009fd0 tx=0x7fecb0004750 comp rx=0 tx=0).stop 2023-03-06T13:49:12.320 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:12.318+0000 7fecbb91c700 1 -- 172.21.15.86:0/1562936266 shutdown_connections 2023-03-06T13:49:12.320 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:12.318+0000 7fecbb91c700 1 --2- 172.21.15.86:0/1562936266 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7fec980682f0 0x7fec9806a7a0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:12.320 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:12.318+0000 7fecbb91c700 1 --2- 172.21.15.86:0/1562936266 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7fecb4150030 0x7fecb41d8cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:12.320 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:12.318+0000 7fecbb91c700 1 --2- 172.21.15.86:0/1562936266 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fecb406deb0 0x7fecb40a4de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:12.320 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:12.318+0000 7fecbb91c700 1 --2- 172.21.15.86:0/1562936266 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fecb40c0d40 0x7fecb40a5de0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:12.320 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:12.318+0000 7fecbb91c700 1 -- 172.21.15.86:0/1562936266 >> 172.21.15.86:0/1562936266 conn(0x7fecb40c1900 msgr2=0x7fecb41d5320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T13:49:12.321 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:12.319+0000 7fecbb91c700 1 -- 172.21.15.86:0/1562936266 shutdown_connections 2023-03-06T13:49:12.321 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:12.319+0000 7fecbb91c700 1 -- 172.21.15.86:0/1562936266 wait complete. 2023-03-06T13:49:12.321 INFO:teuthology.orchestra.run.smithi086.stderr:pool 'cephfs_metadata' created 2023-03-06T13:49:12.337 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-03-06T13:49:12.542 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:12.541+0000 7fd8198cd700 1 Processor -- start 2023-03-06T13:49:12.542 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:12.541+0000 7fd8198cd700 1 -- start start 2023-03-06T13:49:12.544 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:12.542+0000 7fd8198cd700 1 --2- >> v2:172.21.15.202:3300/0 conn(0x7fd8140c2b30 0x7fd8140a72c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:12.544 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:12.542+0000 7fd8198cd700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fd814150e30 0x7fd814159bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:12.544 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:12.542+0000 7fd8198cd700 1 -- --> v1:172.21.15.202:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8140c1a90 con 0x7fd8140a6ef0 2023-03-06T13:49:12.544 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:12.542+0000 7fd8198cd700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8140c0910 con 0x7fd814150e30 2023-03-06T13:49:12.545 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:12.542+0000 7fd8198cd700 1 -- --> v2:172.21.15.202:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd814149770 con 0x7fd8140c2b30 2023-03-06T13:49:12.545 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:12.542+0000 7fd8137fe700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fd814150e30 0x7fd814159bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:12.545 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:12.542+0000 7fd8137fe700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fd814150e30 0x7fd814159bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:38530/0 (socket says 172.21.15.86:38530) 2023-03-06T13:49:12.545 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:12.542+0000 7fd8137fe700 1 -- 172.21.15.86:0/1911749211 learned_addr learned my addr 172.21.15.86:0/1911749211 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-03-06T13:49:12.545 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:12.542+0000 7fd8127fc700 1 --2- 172.21.15.86:0/1911749211 >> v2:172.21.15.202:3300/0 conn(0x7fd8140c2b30 0x7fd8140a72c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:12.545 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:12.542+0000 7fd8137fe700 1 -- 172.21.15.86:0/1911749211 >> v2:172.21.15.202:3300/0 conn(0x7fd8140c2b30 msgr2=0x7fd8140a72c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T13:49:12.545 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:12.542+0000 7fd8137fe700 1 --2- 172.21.15.86:0/1911749211 >> v2:172.21.15.202:3300/0 conn(0x7fd8140c2b30 0x7fd8140a72c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:12.546 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:12.542+0000 7fd8137fe700 1 -- 172.21.15.86:0/1911749211 >> v1:172.21.15.202:6789/0 conn(0x7fd8140a6ef0 legacy=0x7fd814150720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T13:49:12.546 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:12.542+0000 7fd8137fe700 1 -- 172.21.15.86:0/1911749211 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8140c11d0 con 0x7fd814150e30 2023-03-06T13:49:12.546 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:12.542+0000 7fd8137fe700 1 --2- 172.21.15.86:0/1911749211 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd814150e30 0x7fd814159bb0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fd8140c0ee0 tx=0x7fd80c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f890b429e62a77f server_cookie=0 in_seq=0 out_seq=0 2023-03-06T13:49:12.546 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:12.542+0000 7fd811ffb700 1 -- 172.21.15.86:0/1911749211 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd80c00e070 con 0x7fd814150e30 2023-03-06T13:49:12.546 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:12.543+0000 7fd811ffb700 1 -- 172.21.15.86:0/1911749211 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd80c003a20 con 0x7fd814150e30 2023-03-06T13:49:12.546 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:12.543+0000 7fd811ffb700 1 -- 172.21.15.86:0/1911749211 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd80c003dd0 con 0x7fd814150e30 2023-03-06T13:49:12.546 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:12.543+0000 7fd8198cd700 1 -- 172.21.15.86:0/1911749211 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd814150e30 msgr2=0x7fd814159bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:12.547 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:12.543+0000 7fd8198cd700 1 --2- 172.21.15.86:0/1911749211 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd814150e30 0x7fd814159bb0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fd8140c0ee0 tx=0x7fd80c00b330 comp rx=0 tx=0).stop 2023-03-06T13:49:12.547 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:12.543+0000 7fd8198cd700 1 -- 172.21.15.86:0/1911749211 shutdown_connections 2023-03-06T13:49:12.547 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:12.543+0000 7fd8198cd700 1 --2- 172.21.15.86:0/1911749211 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd814150e30 0x7fd814159bb0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:12.547 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:12.543+0000 7fd8198cd700 1 --2- 172.21.15.86:0/1911749211 >> v2:172.21.15.202:3300/0 conn(0x7fd8140c2b30 0x7fd8140a72c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:12.547 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:12.543+0000 7fd8198cd700 1 -- 172.21.15.86:0/1911749211 >> 172.21.15.86:0/1911749211 conn(0x7fd814071a60 msgr2=0x7fd814071e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T13:49:12.547 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:12.543+0000 7fd8198cd700 1 -- 172.21.15.86:0/1911749211 shutdown_connections 2023-03-06T13:49:12.548 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:12.543+0000 7fd8198cd700 1 -- 172.21.15.86:0/1911749211 wait complete. 2023-03-06T13:49:12.551 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:12.544+0000 7fd8198cd700 1 Processor -- start 2023-03-06T13:49:12.551 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:12.544+0000 7fd8198cd700 1 -- start start 2023-03-06T13:49:12.551 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:12.545+0000 7fd8198cd700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd8140a6ef0 0x7fd8141530d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:12.551 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:12.545+0000 7fd8198cd700 1 --2- >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fd8140c2b30 0x7fd8141512c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:12.551 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:12.545+0000 7fd8198cd700 1 --2- >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7fd814150e30 0x7fd814152060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:12.551 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:12.545+0000 7fd8198cd700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8140b2600 con 0x7fd8140a6ef0 2023-03-06T13:49:12.552 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:12.545+0000 7fd8198cd700 1 -- --> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8140b1bb0 con 0x7fd814150e30 2023-03-06T13:49:12.552 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:12.545+0000 7fd8198cd700 1 -- --> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd814153610 con 0x7fd8140c2b30 2023-03-06T13:49:12.552 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:12.545+0000 7fd812ffd700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd8140a6ef0 0x7fd8141530d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:12.552 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:12.545+0000 7fd812ffd700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd8140a6ef0 0x7fd8141530d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:38532/0 (socket says 172.21.15.86:38532) 2023-03-06T13:49:12.552 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:12.545+0000 7fd812ffd700 1 -- 172.21.15.86:0/2814541177 learned_addr learned my addr 172.21.15.86:0/2814541177 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-03-06T13:49:12.552 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:12.545+0000 7fd8127fc700 1 --2- 172.21.15.86:0/2814541177 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fd8140c2b30 0x7fd8141512c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:12.552 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:12.545+0000 7fd8137fe700 1 --2- 172.21.15.86:0/2814541177 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7fd814150e30 0x7fd814152060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:12.553 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:12.545+0000 7fd812ffd700 1 -- 172.21.15.86:0/2814541177 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fd8140c2b30 msgr2=0x7fd8141512c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:12.553 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:12.545+0000 7fd812ffd700 1 --2- 172.21.15.86:0/2814541177 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fd8140c2b30 0x7fd8141512c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:12.553 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:12.545+0000 7fd812ffd700 1 -- 172.21.15.86:0/2814541177 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7fd814150e30 msgr2=0x7fd814152060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:12.553 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:12.545+0000 7fd812ffd700 1 --2- 172.21.15.86:0/2814541177 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7fd814150e30 0x7fd814152060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:12.553 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:12.545+0000 7fd812ffd700 1 -- 172.21.15.86:0/2814541177 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd80c009b30 con 0x7fd8140a6ef0 2023-03-06T13:49:12.553 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:12.545+0000 7fd812ffd700 1 --2- 172.21.15.86:0/2814541177 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd8140a6ef0 0x7fd8141530d0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fd80800b4a0 tx=0x7fd80800b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T13:49:12.554 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:12.546+0000 7fd7fbfff700 1 -- 172.21.15.86:0/2814541177 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd808011830 con 0x7fd8140a6ef0 2023-03-06T13:49:12.554 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:12.546+0000 7fd7fbfff700 1 -- 172.21.15.86:0/2814541177 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd808011990 con 0x7fd8140a6ef0 2023-03-06T13:49:12.554 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:12.546+0000 7fd7fbfff700 1 -- 172.21.15.86:0/2814541177 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd808011d40 con 0x7fd8140a6ef0 2023-03-06T13:49:12.554 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:12.546+0000 7fd8198cd700 1 -- 172.21.15.86:0/2814541177 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8140c1440 con 0x7fd8140a6ef0 2023-03-06T13:49:12.554 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:12.546+0000 7fd8198cd700 1 -- 172.21.15.86:0/2814541177 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd814150050 con 0x7fd8140a6ef0 2023-03-06T13:49:12.554 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:12.547+0000 7fd8198cd700 1 -- 172.21.15.86:0/2814541177 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8140c1720 con 0x7fd8140a6ef0 2023-03-06T13:49:12.554 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:12.547+0000 7fd7fbfff700 1 -- 172.21.15.86:0/2814541177 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fd80800f050 con 0x7fd8140a6ef0 2023-03-06T13:49:12.555 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:12.547+0000 7fd7fbfff700 1 --2- 172.21.15.86:0/2814541177 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7fd8000682f0 0x7fd80006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:12.555 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:12.548+0000 7fd7fbfff700 1 -- 172.21.15.86:0/2814541177 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5580+0+0 (secure 0 0 0) 0x7fd808085620 con 0x7fd8140a6ef0 2023-03-06T13:49:12.555 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:12.548+0000 7fd8127fc700 1 --2- 172.21.15.86:0/2814541177 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7fd8000682f0 0x7fd80006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:12.555 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:12.548+0000 7fd8127fc700 1 --2- 172.21.15.86:0/2814541177 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7fd8000682f0 0x7fd80006a7a0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fd8140c2f00 tx=0x7fd804008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T13:49:12.555 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:12.552+0000 7fd7fbfff700 1 -- 172.21.15.86:0/2814541177 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fd808052060 con 0x7fd8140a6ef0 2023-03-06T13:49:12.737 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:12.736+0000 7fd8198cd700 1 -- 172.21.15.86:0/2814541177 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fd81404e750 con 0x7fd8140a6ef0 2023-03-06T13:49:13.317 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:13.316+0000 7fd7fbfff700 1 -- 172.21.15.86:0/2814541177 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v21) v1 ==== 170+0+0 (secure 0 0 0) 0x7fd808055680 con 0x7fd8140a6ef0 2023-03-06T13:49:13.321 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:13.320+0000 7fd8198cd700 1 -- 172.21.15.86:0/2814541177 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7fd8000682f0 msgr2=0x7fd80006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:13.321 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:13.320+0000 7fd8198cd700 1 --2- 172.21.15.86:0/2814541177 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7fd8000682f0 0x7fd80006a7a0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fd8140c2f00 tx=0x7fd804008040 comp rx=0 tx=0).stop 2023-03-06T13:49:13.322 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:13.320+0000 7fd8198cd700 1 -- 172.21.15.86:0/2814541177 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd8140a6ef0 msgr2=0x7fd8141530d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:13.322 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:13.320+0000 7fd8198cd700 1 --2- 172.21.15.86:0/2814541177 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd8140a6ef0 0x7fd8141530d0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fd80800b4a0 tx=0x7fd80800b860 comp rx=0 tx=0).stop 2023-03-06T13:49:13.322 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:13.320+0000 7fd8198cd700 1 -- 172.21.15.86:0/2814541177 shutdown_connections 2023-03-06T13:49:13.322 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:13.320+0000 7fd8198cd700 1 --2- 172.21.15.86:0/2814541177 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7fd8000682f0 0x7fd80006a7a0 secure :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fd8140c2f00 tx=0x7fd804008040 comp rx=0 tx=0).stop 2023-03-06T13:49:13.322 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:13.320+0000 7fd8198cd700 1 --2- 172.21.15.86:0/2814541177 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd8140a6ef0 0x7fd8141530d0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:13.322 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:13.320+0000 7fd8198cd700 1 --2- 172.21.15.86:0/2814541177 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7fd814150e30 0x7fd814152060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:13.322 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:13.320+0000 7fd8198cd700 1 --2- 172.21.15.86:0/2814541177 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fd8140c2b30 0x7fd8141512c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:13.323 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:13.320+0000 7fd8198cd700 1 -- 172.21.15.86:0/2814541177 >> 172.21.15.86:0/2814541177 conn(0x7fd814071a60 msgr2=0x7fd81414de00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T13:49:13.324 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:13.321+0000 7fd8198cd700 1 -- 172.21.15.86:0/2814541177 shutdown_connections 2023-03-06T13:49:13.324 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:13.323+0000 7fd8198cd700 1 -- 172.21.15.86:0/2814541177 wait complete. 2023-03-06T13:49:13.330 INFO:teuthology.orchestra.run.smithi086.stderr:pool 'cephfs_data' created 2023-03-06T13:49:13.345 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-03-06T13:49:13.470 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:13.469+0000 7f58c39fe700 1 Processor -- start 2023-03-06T13:49:13.470 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:13.469+0000 7f58c39fe700 1 -- start start 2023-03-06T13:49:13.474 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:13.470+0000 7f58c39fe700 1 --2- >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f58bc0bd220 0x7f58bc0c2c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:13.474 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:13.470+0000 7f58c39fe700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58bc146310 con 0x7f58bc0c2860 2023-03-06T13:49:13.474 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:13.470+0000 7f58c39fe700 1 -- --> v1:172.21.15.202:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58bc06d420 con 0x7f58bc14fe60 2023-03-06T13:49:13.474 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:13.470+0000 7f58c39fe700 1 -- --> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58bc14cc50 con 0x7f58bc0bd220 2023-03-06T13:49:13.474 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:13.470+0000 7f58c179a700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f58bc0c2860 0x7f58bc14f750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:48688/0 (socket says 172.21.15.86:48688) 2023-03-06T13:49:13.475 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:13.470+0000 7f58c179a700 1 -- 172.21.15.86:0/1000399130 learned_addr learned my addr 172.21.15.86:0/1000399130 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-03-06T13:49:13.475 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:13.470+0000 7f58c1f9b700 1 --2- 172.21.15.86:0/1000399130 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f58bc0bd220 0x7f58bc0c2c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:13.475 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:13.470+0000 7f58b3fff700 1 -- 172.21.15.86:0/1000399130 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1571741357 0 0) 0x7f58b8001110 con 0x7f58bc0c2860 2023-03-06T13:49:13.475 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:13.470+0000 7f58b3fff700 1 -- 172.21.15.86:0/1000399130 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f58a80035b0 con 0x7f58bc0c2860 2023-03-06T13:49:13.475 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:13.470+0000 7f58b3fff700 1 -- 172.21.15.86:0/1000399130 <== mon.0 v1:172.21.15.86:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3708778067 0 0) 0x7f58a80035b0 con 0x7f58bc0c2860 2023-03-06T13:49:13.475 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:13.470+0000 7f58b3fff700 1 -- 172.21.15.86:0/1000399130 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f58bc0bd220 msgr2=0x7f58bc0c2c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T13:49:13.475 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:13.470+0000 7f58b3fff700 1 --2- 172.21.15.86:0/1000399130 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f58bc0bd220 0x7f58bc0c2c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:13.476 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:13.470+0000 7f58b3fff700 1 -- 172.21.15.86:0/1000399130 >> v1:172.21.15.202:6789/0 conn(0x7f58bc14fe60 legacy=0x7f58bc154760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:13.476 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:13.470+0000 7f58b3fff700 1 -- 172.21.15.86:0/1000399130 --> v1:172.21.15.86:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58bc0bd770 con 0x7f58bc0c2860 2023-03-06T13:49:13.476 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:13.470+0000 7f58b3fff700 1 -- 172.21.15.86:0/1000399130 <== mon.0 v1:172.21.15.86:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2191261126 0 0) 0x7f58b8001800 con 0x7f58bc0c2860 2023-03-06T13:49:13.476 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:13.470+0000 7f58b3fff700 1 -- 172.21.15.86:0/1000399130 >> v1:172.21.15.86:6789/0 conn(0x7f58bc0c2860 legacy=0x7f58bc14f750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:13.476 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:13.470+0000 7f58b3fff700 1 --2- 172.21.15.86:0/1000399130 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f58a8003a30 0x7f58a8003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:13.476 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:13.470+0000 7f58b3fff700 1 --2- 172.21.15.86:0/1000399130 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f58a8004850 0x7f58a8004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:13.476 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:13.470+0000 7f58b3fff700 1 --2- 172.21.15.86:0/1000399130 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f58bc0bd220 0x7f58a8005220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:13.477 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:13.470+0000 7f58b3fff700 1 -- 172.21.15.86:0/1000399130 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58bc14cc50 con 0x7f58a8003a30 2023-03-06T13:49:13.477 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:13.470+0000 7f58b3fff700 1 -- 172.21.15.86:0/1000399130 --> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58a800bb10 con 0x7f58a8004850 2023-03-06T13:49:13.477 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:13.470+0000 7f58b3fff700 1 -- 172.21.15.86:0/1000399130 --> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58a800bcd0 con 0x7f58bc0bd220 2023-03-06T13:49:13.477 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:13.471+0000 7f58c179a700 1 --2- 172.21.15.86:0/1000399130 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f58a8003a30 0x7f58a8003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:13.477 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:13.471+0000 7f58c1f9b700 1 --2- 172.21.15.86:0/1000399130 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f58bc0bd220 0x7f58a8005220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:13.477 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:13.471+0000 7f58c0f99700 1 --2- 172.21.15.86:0/1000399130 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f58a8004850 0x7f58a8004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:13.477 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:13.471+0000 7f58c179a700 1 -- 172.21.15.86:0/1000399130 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f58bc0bd220 msgr2=0x7f58a8005220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T13:49:13.478 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:13.471+0000 7f58c179a700 1 --2- 172.21.15.86:0/1000399130 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f58bc0bd220 0x7f58a8005220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:13.478 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:13.471+0000 7f58c179a700 1 -- 172.21.15.86:0/1000399130 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f58a8004850 msgr2=0x7f58a8004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T13:49:13.478 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:13.471+0000 7f58c179a700 1 --2- 172.21.15.86:0/1000399130 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f58a8004850 0x7f58a8004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:13.478 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:13.471+0000 7f58c179a700 1 -- 172.21.15.86:0/1000399130 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58a80035b0 con 0x7f58a8003a30 2023-03-06T13:49:13.478 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:13.471+0000 7f58c179a700 1 --2- 172.21.15.86:0/1000399130 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f58a8003a30 0x7f58a8003e40 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f58b800c240 tx=0x7f58a8005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4135275e0c83c4a8 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T13:49:13.478 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:13.471+0000 7f58b3fff700 1 -- 172.21.15.86:0/1000399130 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58b8007db0 con 0x7f58a8003a30 2023-03-06T13:49:13.478 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:13.471+0000 7f58b3fff700 1 -- 172.21.15.86:0/1000399130 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58b800cde0 con 0x7f58a8003a30 2023-03-06T13:49:13.478 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:13.471+0000 7f58b3fff700 1 -- 172.21.15.86:0/1000399130 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58b8005ba0 con 0x7f58a8003a30 2023-03-06T13:49:13.479 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:13.472+0000 7f58c39fe700 1 -- 172.21.15.86:0/1000399130 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f58a8003a30 msgr2=0x7f58a8003e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:13.479 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:13.472+0000 7f58c39fe700 1 --2- 172.21.15.86:0/1000399130 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f58a8003a30 0x7f58a8003e40 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f58b800c240 tx=0x7f58a8005880 comp rx=0 tx=0).stop 2023-03-06T13:49:13.479 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:13.472+0000 7f58c1f9b700 1 -- 172.21.15.86:0/1000399130 reap_dead start 2023-03-06T13:49:13.479 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:13.472+0000 7f58c39fe700 1 -- 172.21.15.86:0/1000399130 shutdown_connections 2023-03-06T13:49:13.479 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:13.472+0000 7f58c39fe700 1 -- 172.21.15.86:0/1000399130 >> 172.21.15.86:0/1000399130 conn(0x7f58bc06c0d0 msgr2=0x7f58bc0c2150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T13:49:13.479 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:13.472+0000 7f58c39fe700 1 -- 172.21.15.86:0/1000399130 shutdown_connections 2023-03-06T13:49:13.479 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:13.472+0000 7f58c39fe700 1 -- 172.21.15.86:0/1000399130 wait complete. 2023-03-06T13:49:13.480 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:13.473+0000 7f58c39fe700 1 Processor -- start 2023-03-06T13:49:13.480 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:13.473+0000 7f58c39fe700 1 -- start start 2023-03-06T13:49:13.482 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:13.473+0000 7f58c39fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f58a8003a30 0x7f58bc1437a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:13.482 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:13.473+0000 7f58c39fe700 1 --2- >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f58bc0a7710 0x7f58bc1e7f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:13.483 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:13.473+0000 7f58c39fe700 1 --2- >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f58bc146c70 0x7f58bc1d6b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:13.483 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:13.473+0000 7f58c39fe700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58bc143ce0 con 0x7f58a8003a30 2023-03-06T13:49:13.483 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:13.473+0000 7f58c39fe700 1 -- --> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58bc1d5240 con 0x7f58bc146c70 2023-03-06T13:49:13.483 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:13.473+0000 7f58c39fe700 1 -- --> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58bc1d4f60 con 0x7f58bc0a7710 2023-03-06T13:49:13.483 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:13.474+0000 7f58c179a700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f58a8003a30 0x7f58bc1437a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:13.483 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:13.474+0000 7f58c179a700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f58a8003a30 0x7f58bc1437a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:38552/0 (socket says 172.21.15.86:38552) 2023-03-06T13:49:13.483 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:13.474+0000 7f58c179a700 1 -- 172.21.15.86:0/2414655844 learned_addr learned my addr 172.21.15.86:0/2414655844 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-03-06T13:49:13.484 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:13.474+0000 7f58c1f9b700 1 --2- 172.21.15.86:0/2414655844 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f58bc146c70 0x7f58bc1d6b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:13.484 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:13.474+0000 7f58c0f99700 1 --2- 172.21.15.86:0/2414655844 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f58bc0a7710 0x7f58bc1e7f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:13.484 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:13.474+0000 7f58c179a700 1 -- 172.21.15.86:0/2414655844 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f58bc0a7710 msgr2=0x7f58bc1e7f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:13.484 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:13.474+0000 7f58c179a700 1 --2- 172.21.15.86:0/2414655844 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f58bc0a7710 0x7f58bc1e7f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:13.484 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:13.474+0000 7f58c179a700 1 -- 172.21.15.86:0/2414655844 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f58bc146c70 msgr2=0x7f58bc1d6b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:13.484 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:13.474+0000 7f58c179a700 1 --2- 172.21.15.86:0/2414655844 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f58bc146c70 0x7f58bc1d6b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:13.484 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:13.474+0000 7f58c179a700 1 -- 172.21.15.86:0/2414655844 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58bc0bdd30 con 0x7f58a8003a30 2023-03-06T13:49:13.485 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:13.474+0000 7f58c1f9b700 1 --2- 172.21.15.86:0/2414655844 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f58bc146c70 0x7f58bc1d6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-06T13:49:13.485 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:13.474+0000 7f58c179a700 1 --2- 172.21.15.86:0/2414655844 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f58a8003a30 0x7f58bc1437a0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f58a800bae0 tx=0x7f58b8001b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T13:49:13.485 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:13.474+0000 7f58b1ffb700 1 -- 172.21.15.86:0/2414655844 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58b8001c20 con 0x7f58a8003a30 2023-03-06T13:49:13.485 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:13.474+0000 7f58b1ffb700 1 -- 172.21.15.86:0/2414655844 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58b80015c0 con 0x7f58a8003a30 2023-03-06T13:49:13.485 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:13.474+0000 7f58c39fe700 1 -- 172.21.15.86:0/2414655844 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58bc0bda50 con 0x7f58a8003a30 2023-03-06T13:49:13.485 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:13.474+0000 7f58b1ffb700 1 -- 172.21.15.86:0/2414655844 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58b80072f0 con 0x7f58a8003a30 2023-03-06T13:49:13.485 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:13.474+0000 7f58c39fe700 1 -- 172.21.15.86:0/2414655844 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58bc0723b0 con 0x7f58a8003a30 2023-03-06T13:49:13.485 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:13.475+0000 7f58c39fe700 1 -- 172.21.15.86:0/2414655844 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58bc14c3d0 con 0x7f58a8003a30 2023-03-06T13:49:13.486 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:13.476+0000 7f58b1ffb700 1 -- 172.21.15.86:0/2414655844 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f58b8024030 con 0x7f58a8003a30 2023-03-06T13:49:13.486 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:13.476+0000 7f58b1ffb700 1 --2- 172.21.15.86:0/2414655844 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7f58a0068320 0x7f58a006a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:13.486 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:13.476+0000 7f58b1ffb700 1 -- 172.21.15.86:0/2414655844 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5962+0+0 (secure 0 0 0) 0x7f58b8086ea0 con 0x7f58a8003a30 2023-03-06T13:49:13.486 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:13.476+0000 7f58c0f99700 1 --2- 172.21.15.86:0/2414655844 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7f58a0068320 0x7f58a006a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:13.486 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:13.476+0000 7f58c0f99700 1 --2- 172.21.15.86:0/2414655844 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7f58a0068320 0x7f58a006a7d0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f58bc0a76c0 tx=0x7f58ac009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T13:49:13.486 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:13.481+0000 7f58b1ffb700 1 -- 172.21.15.86:0/2414655844 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f58b80536e0 con 0x7f58a8003a30 2023-03-06T13:49:13.706 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:13.705+0000 7f58c39fe700 1 -- 172.21.15.86:0/2414655844 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f58bc146310 con 0x7f58a8003a30 2023-03-06T13:49:13.711 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:13.710+0000 7f58b1ffb700 1 -- 172.21.15.86:0/2414655844 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 3 and data pool 4 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f58bc146310 con 0x7f58a8003a30 2023-03-06T13:49:13.716 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:13.715+0000 7f58c39fe700 1 -- 172.21.15.86:0/2414655844 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7f58a0068320 msgr2=0x7f58a006a7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:13.716 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:13.715+0000 7f58c39fe700 1 --2- 172.21.15.86:0/2414655844 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7f58a0068320 0x7f58a006a7d0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f58bc0a76c0 tx=0x7f58ac009040 comp rx=0 tx=0).stop 2023-03-06T13:49:13.717 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:13.715+0000 7f58c39fe700 1 -- 172.21.15.86:0/2414655844 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f58a8003a30 msgr2=0x7f58bc1437a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:13.717 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:13.715+0000 7f58c39fe700 1 --2- 172.21.15.86:0/2414655844 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f58a8003a30 0x7f58bc1437a0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f58a800bae0 tx=0x7f58b8001b90 comp rx=0 tx=0).stop 2023-03-06T13:49:13.717 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:13.716+0000 7f58c39fe700 1 -- 172.21.15.86:0/2414655844 shutdown_connections 2023-03-06T13:49:13.717 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:13.716+0000 7f58c39fe700 1 --2- 172.21.15.86:0/2414655844 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7f58a0068320 0x7f58a006a7d0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:13.718 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:13.716+0000 7f58c39fe700 1 --2- 172.21.15.86:0/2414655844 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f58a8003a30 0x7f58bc1437a0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:13.718 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:13.716+0000 7f58c39fe700 1 --2- 172.21.15.86:0/2414655844 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f58bc146c70 0x7f58bc1d6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:13.718 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:13.716+0000 7f58c39fe700 1 --2- 172.21.15.86:0/2414655844 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f58bc0a7710 0x7f58bc1e7f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:13.718 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:13.716+0000 7f58c39fe700 1 -- 172.21.15.86:0/2414655844 >> 172.21.15.86:0/2414655844 conn(0x7f58bc06c0d0 msgr2=0x7f58bc145830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T13:49:13.718 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:13.717+0000 7f58c39fe700 1 -- 172.21.15.86:0/2414655844 shutdown_connections 2023-03-06T13:49:13.719 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:13.717+0000 7f58c39fe700 1 -- 172.21.15.86:0/2414655844 wait complete. 2023-03-06T13:49:13.727 INFO:teuthology.orchestra.run.smithi086.stderr:new fs with metadata pool 3 and data pool 4 2023-03-06T13:49:13.740 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-03-06T13:49:13.867 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:13.859+0000 7f6bb59cb700 1 Processor -- start 2023-03-06T13:49:13.867 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:13.859+0000 7f6bb59cb700 1 -- start start 2023-03-06T13:49:13.867 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:13.859+0000 7f6bb59cb700 1 --2- >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f6bb0149760 0x7f6bb00c2660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:13.868 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:13.859+0000 7f6bb59cb700 1 --2- >> v2:172.21.15.202:3300/0 conn(0x7f6bb00c2ba0 0x7f6bb006a610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:13.868 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:13.859+0000 7f6bb59cb700 1 -- --> v1:172.21.15.202:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6bb00c08a0 con 0x7f6bb006ab50 2023-03-06T13:49:13.868 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:13.859+0000 7f6bb59cb700 1 -- --> v2:172.21.15.202:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6bb006b970 con 0x7f6bb00c2ba0 2023-03-06T13:49:13.868 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:13.859+0000 7f6bb59cb700 1 -- --> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bb006b330 con 0x7f6bb0149760 2023-03-06T13:49:13.869 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:13.860+0000 7f6bae7fc700 1 --2- >> v2:172.21.15.202:3300/0 conn(0x7f6bb00c2ba0 0x7f6bb006a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:13.869 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:13.860+0000 7f6baeffd700 1 --2- >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f6bb0149760 0x7f6bb00c2660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:13.869 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:13.860+0000 7f6baf7fe700 1 --1- >> v1:172.21.15.202:6789/0 conn(0x7f6bb006ab50 0x7f6bb0152860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.202:6789/0 says I am v1:172.21.15.86:47766/0 (socket says 172.21.15.86:47766) 2023-03-06T13:49:13.870 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:13.860+0000 7f6baf7fe700 1 -- 172.21.15.86:0/1177734243 learned_addr learned my addr 172.21.15.86:0/1177734243 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-03-06T13:49:13.870 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:13.860+0000 7f6bae7fc700 1 -- 172.21.15.86:0/1177734243 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f6bb0149760 msgr2=0x7f6bb00c2660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T13:49:13.870 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:13.860+0000 7f6bae7fc700 1 --2- 172.21.15.86:0/1177734243 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f6bb0149760 0x7f6bb00c2660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:13.870 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:13.860+0000 7f6bae7fc700 1 -- 172.21.15.86:0/1177734243 >> v1:172.21.15.202:6789/0 conn(0x7f6bb006ab50 legacy=0x7f6bb0152860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:13.871 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:13.860+0000 7f6badffb700 1 -- 172.21.15.86:0/1177734243 <== mon.1 v1:172.21.15.202:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 217487487 0 0) 0x7f6bb00c08a0 con 0x7f6bb006ab50 2023-03-06T13:49:13.871 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:13.860+0000 7f6bae7fc700 1 -- 172.21.15.86:0/1177734243 --> v2:172.21.15.202:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bb00c1d50 con 0x7f6bb00c2ba0 2023-03-06T13:49:13.871 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:13.860+0000 7f6bae7fc700 1 --2- 172.21.15.86:0/1177734243 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f6bb00c2ba0 0x7f6bb006a610 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f6ba4009840 tx=0x7f6ba4009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4e86d3f5b1713c9c server_cookie=0 in_seq=0 out_seq=0 2023-03-06T13:49:13.871 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:13.860+0000 7f6badffb700 1 -- 172.21.15.86:0/1177734243 <== mon.1 v2:172.21.15.202:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ba4011830 con 0x7f6bb00c2ba0 2023-03-06T13:49:13.872 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:13.861+0000 7f6badffb700 1 -- 172.21.15.86:0/1177734243 <== mon.1 v2:172.21.15.202:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ba4011990 con 0x7f6bb00c2ba0 2023-03-06T13:49:13.872 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:13.861+0000 7f6badffb700 1 -- 172.21.15.86:0/1177734243 <== mon.1 v2:172.21.15.202:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ba4011d20 con 0x7f6bb00c2ba0 2023-03-06T13:49:13.873 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:13.861+0000 7f6bb59cb700 1 -- 172.21.15.86:0/1177734243 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f6bb00c2ba0 msgr2=0x7f6bb006a610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:13.874 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:13.861+0000 7f6bb59cb700 1 --2- 172.21.15.86:0/1177734243 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f6bb00c2ba0 0x7f6bb006a610 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f6ba4009840 tx=0x7f6ba4009b50 comp rx=0 tx=0).stop 2023-03-06T13:49:13.875 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:13.861+0000 7f6bb59cb700 1 -- 172.21.15.86:0/1177734243 shutdown_connections 2023-03-06T13:49:13.875 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:13.861+0000 7f6bb59cb700 1 --2- 172.21.15.86:0/1177734243 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f6bb0149760 0x7f6bb00c2660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:13.875 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:13.861+0000 7f6bb59cb700 1 --2- 172.21.15.86:0/1177734243 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f6bb00c2ba0 0x7f6bb006a610 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:13.875 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:13.861+0000 7f6bb59cb700 1 -- 172.21.15.86:0/1177734243 >> 172.21.15.86:0/1177734243 conn(0x7f6bb00c6160 msgr2=0x7f6bb00c1f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T13:49:13.876 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:13.861+0000 7f6bb59cb700 1 -- 172.21.15.86:0/1177734243 shutdown_connections 2023-03-06T13:49:13.876 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:13.861+0000 7f6bb59cb700 1 -- 172.21.15.86:0/1177734243 wait complete. 2023-03-06T13:49:13.876 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:13.862+0000 7f6bb59cb700 1 Processor -- start 2023-03-06T13:49:13.877 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:13.862+0000 7f6bb59cb700 1 -- start start 2023-03-06T13:49:13.877 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:13.863+0000 7f6bb59cb700 1 --2- >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f6bb006ab50 0x7f6bb014bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:13.877 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:13.863+0000 7f6bb59cb700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6bb00c2ba0 0x7f6bb00a8db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:13.877 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:13.863+0000 7f6bb59cb700 1 --2- >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f6bb0149760 0x7f6bb00aaf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:13.878 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:13.863+0000 7f6bb59cb700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bb00aa3d0 con 0x7f6bb00c2ba0 2023-03-06T13:49:13.878 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:13.863+0000 7f6bb59cb700 1 -- --> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bb01e89e0 con 0x7f6bb0149760 2023-03-06T13:49:13.878 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:13.863+0000 7f6bb59cb700 1 -- --> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bb014b0f0 con 0x7f6bb006ab50 2023-03-06T13:49:13.879 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:13.863+0000 7f6bae7fc700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6bb00c2ba0 0x7f6bb00a8db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:13.879 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:13.863+0000 7f6bae7fc700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6bb00c2ba0 0x7f6bb00a8db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:38568/0 (socket says 172.21.15.86:38568) 2023-03-06T13:49:13.879 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:13.863+0000 7f6bae7fc700 1 -- 172.21.15.86:0/2833109399 learned_addr learned my addr 172.21.15.86:0/2833109399 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-03-06T13:49:13.880 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:13.863+0000 7f6baf7fe700 1 --2- 172.21.15.86:0/2833109399 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f6bb0149760 0x7f6bb00aaf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:13.880 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:13.863+0000 7f6baeffd700 1 --2- 172.21.15.86:0/2833109399 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f6bb006ab50 0x7f6bb014bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:13.880 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:13.863+0000 7f6bae7fc700 1 -- 172.21.15.86:0/2833109399 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f6bb006ab50 msgr2=0x7f6bb014bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:13.881 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:13.863+0000 7f6bae7fc700 1 --2- 172.21.15.86:0/2833109399 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f6bb006ab50 0x7f6bb014bcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:13.881 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:13.863+0000 7f6bae7fc700 1 -- 172.21.15.86:0/2833109399 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f6bb0149760 msgr2=0x7f6bb00aaf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:13.881 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:13.863+0000 7f6bae7fc700 1 --2- 172.21.15.86:0/2833109399 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f6bb0149760 0x7f6bb00aaf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:13.882 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:13.863+0000 7f6bae7fc700 1 -- 172.21.15.86:0/2833109399 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ba40094a0 con 0x7f6bb00c2ba0 2023-03-06T13:49:13.882 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:13.863+0000 7f6bae7fc700 1 --2- 172.21.15.86:0/2833109399 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6bb00c2ba0 0x7f6bb00a8db0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f6ba40090b0 tx=0x7f6ba4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T13:49:13.883 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:13.864+0000 7f6b97fff700 1 -- 172.21.15.86:0/2833109399 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ba40038a0 con 0x7f6bb00c2ba0 2023-03-06T13:49:13.883 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:13.864+0000 7f6b97fff700 1 -- 172.21.15.86:0/2833109399 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ba401f070 con 0x7f6bb00c2ba0 2023-03-06T13:49:13.883 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:13.864+0000 7f6bb59cb700 1 -- 172.21.15.86:0/2833109399 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bb00c01f0 con 0x7f6bb00c2ba0 2023-03-06T13:49:13.883 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:13.864+0000 7f6b97fff700 1 -- 172.21.15.86:0/2833109399 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ba4003c00 con 0x7f6bb00c2ba0 2023-03-06T13:49:13.883 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:13.864+0000 7f6bb59cb700 1 -- 172.21.15.86:0/2833109399 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bb008b9c0 con 0x7f6bb00c2ba0 2023-03-06T13:49:13.883 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:13.865+0000 7f6bb59cb700 1 -- 172.21.15.86:0/2833109399 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bb00c19e0 con 0x7f6bb00c2ba0 2023-03-06T13:49:13.884 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:13.865+0000 7f6b97fff700 1 -- 172.21.15.86:0/2833109399 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f6ba400f050 con 0x7f6bb00c2ba0 2023-03-06T13:49:13.884 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:13.865+0000 7f6b97fff700 1 --2- 172.21.15.86:0/2833109399 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7f6b9c0682f0 0x7f6b9c06a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:13.884 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:13.865+0000 7f6b97fff700 1 -- 172.21.15.86:0/2833109399 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f6ba4021070 con 0x7f6bb00c2ba0 2023-03-06T13:49:13.884 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:13.865+0000 7f6baeffd700 1 --2- 172.21.15.86:0/2833109399 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7f6b9c0682f0 0x7f6b9c06a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:13.884 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:13.866+0000 7f6baeffd700 1 --2- 172.21.15.86:0/2833109399 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7f6b9c0682f0 0x7f6b9c06a7a0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f6ba0009a10 tx=0x7f6ba0008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T13:49:13.885 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:13.870+0000 7f6b97fff700 1 -- 172.21.15.86:0/2833109399 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f6ba4053e10 con 0x7f6bb00c2ba0 2023-03-06T13:49:14.055 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:14.054+0000 7f6bb59cb700 1 -- 172.21.15.86:0/2833109399 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6bb004e750 con 0x7f6bb00c2ba0 2023-03-06T13:49:14.056 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:14.056+0000 7f6b97fff700 1 -- 172.21.15.86:0/2833109399 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+17824 (secure 0 0 0) 0x7f6ba4057430 con 0x7f6bb00c2ba0 2023-03-06T13:49:14.057 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-03-06T13:49:14.057 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":22,"fsid":"2cca6c77-50cb-47d8-a8c7-444575d01327","created":"2023-03-06T13:48:48.337369+0000","modified":"2023-03-06T13:49:13.706339+0000","last_up_change":"2023-03-06T13:48:59.782729+0000","last_in_change":"2023-03-06T13:48:50.777249+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-03-06T13:48:59.879087+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-03-06T13:49:06.686394+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-03-06T13:49:11.362997+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-03-06T13:49:12.753969+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2de68e69-e10f-49e1-a15a-8a9bfff504c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":96739},{"type":"v1","addr":"172.21.15.86:6816","nonce":96739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":96739},{"type":"v1","addr":"172.21.15.86:6819","nonce":96739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":96739},{"type":"v1","addr":"172.21.15.86:6823","nonce":96739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":96739},{"type":"v1","addr":"172.21.15.86:6821","nonce":96739}]},"public_addr":"172.21.15.86:6816/96739","cluster_addr":"172.21.15.86:6819/96739","heartbeat_back_addr":"172.21.15.86:6823/96739","heartbeat_front_addr":"172.21.15.86:6821/96739","state":["exists","up"]},{"osd":1,"uuid":"3e75c061-0de5-4742-a20d-4b5a4adb9b81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":96738},{"type":"v1","addr":"172.21.15.86:6801","nonce":96738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":96738},{"type":"v1","addr":"172.21.15.86:6803","nonce":96738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":96738},{"type":"v1","addr":"172.21.15.86:6807","nonce":96738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":96738},{"type":"v1","addr":"172.21.15.86:6805","nonce":96738}]},"public_addr":"172.21.15.86:6801/96738","cluster_addr":"172.21.15.86:6803/96738","heartbeat_back_addr":"172.21.15.86:6807/96738","heartbeat_front_addr":"172.21.15.86:6805/96738","state":["exists","up"]},{"osd":2,"uuid":"38d71bce-81c2-4e33-91e1-65efb08f2291","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":96740},{"type":"v1","addr":"172.21.15.86:6809","nonce":96740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":96740},{"type":"v1","addr":"172.21.15.86:6811","nonce":96740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6815","nonce":96740},{"type":"v1","addr":"172.21.15.86:6817","nonce":96740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":96740},{"type":"v1","addr":"172.21.15.86:6813","nonce":96740}]},"public_addr":"172.21.15.86:6809/96740","cluster_addr":"172.21.15.86:6811/96740","heartbeat_back_addr":"172.21.15.86:6817/96740","heartbeat_front_addr":"172.21.15.86:6813/96740","state":["exists","up"]},{"osd":3,"uuid":"d95a2686-21bd-4b66-9ea5-eef65403935b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":96756},{"type":"v1","addr":"172.21.15.86:6825","nonce":96756}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":96756},{"type":"v1","addr":"172.21.15.86:6827","nonce":96756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":96756},{"type":"v1","addr":"172.21.15.86:6831","nonce":96756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":96756},{"type":"v1","addr":"172.21.15.86:6829","nonce":96756}]},"public_addr":"172.21.15.86:6825/96756","cluster_addr":"172.21.15.86:6827/96756","heartbeat_back_addr":"172.21.15.86:6831/96756","heartbeat_front_addr":"172.21.15.86:6829/96756","state":["exists","up"]},{"osd":4,"uuid":"98c7e359-0f00-496a-8aaa-5472af355e48","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.202:6816","nonce":96847},{"type":"v1","addr":"172.21.15.202:6817","nonce":96847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.202:6818","nonce":96847},{"type":"v1","addr":"172.21.15.202:6819","nonce":96847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.202:6822","nonce":96847},{"type":"v1","addr":"172.21.15.202:6823","nonce":96847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.202:6820","nonce":96847},{"type":"v1","addr":"172.21.15.202:6821","nonce":96847}]},"public_addr":"172.21.15.202:6817/96847","cluster_addr":"172.21.15.202:6819/96847","heartbeat_back_addr":"172.21.15.202:6823/96847","heartbeat_front_addr":"172.21.15.202:6821/96847","state":["exists","up"]},{"osd":5,"uuid":"fa6688d9-73f3-4593-a50e-d96a0fe5f4cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.202:6824","nonce":96848},{"type":"v1","addr":"172.21.15.202:6825","nonce":96848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.202:6826","nonce":96848},{"type":"v1","addr":"172.21.15.202:6827","nonce":96848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.202:6830","nonce":96848},{"type":"v1","addr":"172.21.15.202:6831","nonce":96848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.202:6828","nonce":96848},{"type":"v1","addr":"172.21.15.202:6829","nonce":96848}]},"public_addr":"172.21.15.202:6825/96848","cluster_addr":"172.21.15.202:6827/96848","heartbeat_back_addr":"172.21.15.202:6831/96848","heartbeat_front_addr":"172.21.15.202:6829/96848","state":["exists","up"]},{"osd":6,"uuid":"7bfc6dc0-2388-4498-9cd7-766e3606f6a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.202:6808","nonce":96845},{"type":"v1","addr":"172.21.15.202:6809","nonce":96845}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.202:6810","nonce":96845},{"type":"v1","addr":"172.21.15.202:6811","nonce":96845}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.202:6814","nonce":96845},{"type":"v1","addr":"172.21.15.202:6815","nonce":96845}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.202:6812","nonce":96845},{"type":"v1","addr":"172.21.15.202:6813","nonce":96845}]},"public_addr":"172.21.15.202:6809/96845","cluster_addr":"172.21.15.202:6811/96845","heartbeat_back_addr":"172.21.15.202:6815/96845","heartbeat_front_addr":"172.21.15.202:6813/96845","state":["exists","up"]},{"osd":7,"uuid":"c475f863-96fd-48e3-8033-7d1c3b1d503f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.202:6800","nonce":96846},{"type":"v1","addr":"172.21.15.202:6801","nonce":96846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.202:6802","nonce":96846},{"type":"v1","addr":"172.21.15.202:6803","nonce":96846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.202:6806","nonce":96846},{"type":"v1","addr":"172.21.15.202:6807","nonce":96846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.202:6804","nonce":96846},{"type":"v1","addr":"172.21.15.202:6805","nonce":96846}]},"public_addr":"172.21.15.202:6801/96846","cluster_addr":"172.21.15.202:6803/96846","heartbeat_back_addr":"172.21.15.202:6807/96846","heartbeat_front_addr":"172.21.15.202:6805/96846","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-06T13:48:55.997991+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-06T13:48:55.930805+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-06T13:48:56.000312+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-06T13:48:55.998360+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-06T13:48:56.052762+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-06T13:48:56.036049+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-06T13:48:56.048751+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-06T13:48:56.011928+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-03-06T13:49:14.058 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:14.057+0000 7f6bb59cb700 1 -- 172.21.15.86:0/2833109399 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7f6b9c0682f0 msgr2=0x7f6b9c06a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:14.059 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:14.057+0000 7f6bb59cb700 1 --2- 172.21.15.86:0/2833109399 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7f6b9c0682f0 0x7f6b9c06a7a0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f6ba0009a10 tx=0x7f6ba0008040 comp rx=0 tx=0).stop 2023-03-06T13:49:14.059 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:14.057+0000 7f6bb59cb700 1 -- 172.21.15.86:0/2833109399 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6bb00c2ba0 msgr2=0x7f6bb00a8db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:14.059 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:14.057+0000 7f6bb59cb700 1 --2- 172.21.15.86:0/2833109399 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6bb00c2ba0 0x7f6bb00a8db0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f6ba40090b0 tx=0x7f6ba4004750 comp rx=0 tx=0).stop 2023-03-06T13:49:14.059 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:14.058+0000 7f6bb59cb700 1 -- 172.21.15.86:0/2833109399 shutdown_connections 2023-03-06T13:49:14.059 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:14.058+0000 7f6bb59cb700 1 --2- 172.21.15.86:0/2833109399 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7f6b9c0682f0 0x7f6b9c06a7a0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:14.059 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:14.058+0000 7f6bb59cb700 1 --2- 172.21.15.86:0/2833109399 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f6bb0149760 0x7f6bb00aaf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:14.059 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:14.058+0000 7f6bb59cb700 1 --2- 172.21.15.86:0/2833109399 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f6bb006ab50 0x7f6bb014bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:14.060 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:14.058+0000 7f6bb59cb700 1 --2- 172.21.15.86:0/2833109399 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6bb00c2ba0 0x7f6bb00a8db0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:14.060 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:14.058+0000 7f6bb59cb700 1 -- 172.21.15.86:0/2833109399 >> 172.21.15.86:0/2833109399 conn(0x7f6bb00c6160 msgr2=0x7f6bb00a5bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T13:49:14.060 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:14.058+0000 7f6bb59cb700 1 -- 172.21.15.86:0/2833109399 shutdown_connections 2023-03-06T13:49:14.060 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:14.058+0000 7f6bb59cb700 1 -- 172.21.15.86:0/2833109399 wait complete. 2023-03-06T13:49:14.074 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-03-06T13:49:14.194 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:14.193+0000 7f88222d7700 1 Processor -- start 2023-03-06T13:49:14.194 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:14.193+0000 7f88222d7700 1 -- start start 2023-03-06T13:49:14.197 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:14.194+0000 7f88222d7700 1 --2- >> v2:172.21.15.202:3300/0 conn(0x7f881c0c2860 0x7f881c0c2c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:14.197 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:14.194+0000 7f88222d7700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f881c0bd220 0x7f881c14f750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:14.197 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:14.194+0000 7f88222d7700 1 --2- >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f881c14fc90 0x7f881c06d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:14.197 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:14.194+0000 7f88222d7700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f881c146310 con 0x7f881c0bd220 2023-03-06T13:49:14.197 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:14.194+0000 7f88222d7700 1 -- --> v2:172.21.15.202:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f881c1500d0 con 0x7f881c0c2860 2023-03-06T13:49:14.198 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:14.194+0000 7f88222d7700 1 -- --> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f881c06d420 con 0x7f881c14fc90 2023-03-06T13:49:14.198 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:14.194+0000 7f881b7fe700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f881c0bd220 0x7f881c14f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:14.198 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:14.194+0000 7f881b7fe700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f881c0bd220 0x7f881c14f750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:38574/0 (socket says 172.21.15.86:38574) 2023-03-06T13:49:14.198 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:14.194+0000 7f881b7fe700 1 -- 172.21.15.86:0/1503818259 learned_addr learned my addr 172.21.15.86:0/1503818259 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-03-06T13:49:14.198 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:14.194+0000 7f881bfff700 1 --2- 172.21.15.86:0/1503818259 >> v2:172.21.15.202:3300/0 conn(0x7f881c0c2860 0x7f881c0c2c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:14.198 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:14.194+0000 7f881b7fe700 1 -- 172.21.15.86:0/1503818259 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f881c14fc90 msgr2=0x7f881c06d8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T13:49:14.198 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:14.194+0000 7f8820874700 1 --2- 172.21.15.86:0/1503818259 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f881c14fc90 0x7f881c06d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:14.199 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:14.194+0000 7f881b7fe700 1 --2- 172.21.15.86:0/1503818259 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f881c14fc90 0x7f881c06d8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:14.199 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:14.194+0000 7f881b7fe700 1 -- 172.21.15.86:0/1503818259 >> v2:172.21.15.202:3300/0 conn(0x7f881c0c2860 msgr2=0x7f881c0c2c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T13:49:14.199 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:14.194+0000 7f881b7fe700 1 --2- 172.21.15.86:0/1503818259 >> v2:172.21.15.202:3300/0 conn(0x7f881c0c2860 0x7f881c0c2c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:14.199 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:14.194+0000 7f881b7fe700 1 -- 172.21.15.86:0/1503818259 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f881c14cc50 con 0x7f881c0bd220 2023-03-06T13:49:14.199 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:14.194+0000 7f881bfff700 1 --2- 172.21.15.86:0/1503818259 >> v2:172.21.15.202:3300/0 conn(0x7f881c0c2860 0x7f881c0c2c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-06T13:49:14.199 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:14.194+0000 7f8820874700 1 --2- 172.21.15.86:0/1503818259 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f881c14fc90 0x7f881c06d8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-06T13:49:14.199 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:14.195+0000 7f881b7fe700 1 --2- 172.21.15.86:0/1503818259 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f881c0bd220 0x7f881c14f750 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f881c0676e0 tx=0x7f880c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1192feed4d28f0f server_cookie=0 in_seq=0 out_seq=0 2023-03-06T13:49:14.199 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:14.195+0000 7f881affd700 1 -- 172.21.15.86:0/1503818259 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f880c00b870 con 0x7f881c0bd220 2023-03-06T13:49:14.200 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:14.195+0000 7f881affd700 1 -- 172.21.15.86:0/1503818259 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f880c00b9d0 con 0x7f881c0bd220 2023-03-06T13:49:14.200 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:14.195+0000 7f881affd700 1 -- 172.21.15.86:0/1503818259 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f880c00bd60 con 0x7f881c0bd220 2023-03-06T13:49:14.200 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:14.195+0000 7f88222d7700 1 -- 172.21.15.86:0/1503818259 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f881c0bd220 msgr2=0x7f881c14f750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:14.200 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:14.195+0000 7f88222d7700 1 --2- 172.21.15.86:0/1503818259 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f881c0bd220 0x7f881c14f750 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f881c0676e0 tx=0x7f880c009bd0 comp rx=0 tx=0).stop 2023-03-06T13:49:14.200 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:14.195+0000 7f88222d7700 1 -- 172.21.15.86:0/1503818259 shutdown_connections 2023-03-06T13:49:14.200 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:14.195+0000 7f88222d7700 1 --2- 172.21.15.86:0/1503818259 >> v2:172.21.15.202:3300/0 conn(0x7f881c0c2860 0x7f881c0c2c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:14.200 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:14.195+0000 7f88222d7700 1 --2- 172.21.15.86:0/1503818259 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f881c14fc90 0x7f881c06d8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:14.200 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:14.195+0000 7f88222d7700 1 --2- 172.21.15.86:0/1503818259 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f881c0bd220 0x7f881c14f750 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:14.201 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:14.195+0000 7f88222d7700 1 -- 172.21.15.86:0/1503818259 >> 172.21.15.86:0/1503818259 conn(0x7f881c06c0d0 msgr2=0x7f881c0c2150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T13:49:14.201 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:14.195+0000 7f88222d7700 1 -- 172.21.15.86:0/1503818259 shutdown_connections 2023-03-06T13:49:14.201 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:14.195+0000 7f88222d7700 1 -- 172.21.15.86:0/1503818259 wait complete. 2023-03-06T13:49:14.204 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:14.196+0000 7f88222d7700 1 Processor -- start 2023-03-06T13:49:14.204 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:14.197+0000 7f88222d7700 1 -- start start 2023-03-06T13:49:14.204 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:14.197+0000 7f88222d7700 1 --2- >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f881c0bd220 0x7f881c0a7b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:14.204 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:14.197+0000 7f88222d7700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f881c0c2860 0x7f881c144f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:14.204 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:14.197+0000 7f88222d7700 1 --2- >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f881c14fc90 0x7f881c0c1610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:14.204 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:14.197+0000 7f88222d7700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f881c14f0c0 con 0x7f881c0c2860 2023-03-06T13:49:14.205 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:14.197+0000 7f88222d7700 1 -- --> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f881c0a80a0 con 0x7f881c0bd220 2023-03-06T13:49:14.205 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:14.197+0000 7f88222d7700 1 -- --> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f881c1e0fc0 con 0x7f881c14fc90 2023-03-06T13:49:14.205 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:14.197+0000 7f881b7fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f881c0c2860 0x7f881c144f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:14.205 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:14.197+0000 7f881b7fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f881c0c2860 0x7f881c144f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:38582/0 (socket says 172.21.15.86:38582) 2023-03-06T13:49:14.205 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:14.197+0000 7f881b7fe700 1 -- 172.21.15.86:0/3484298340 learned_addr learned my addr 172.21.15.86:0/3484298340 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-03-06T13:49:14.205 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:14.197+0000 7f881bfff700 1 --2- 172.21.15.86:0/3484298340 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f881c0bd220 0x7f881c0a7b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:14.205 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:14.197+0000 7f8820874700 1 --2- 172.21.15.86:0/3484298340 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f881c14fc90 0x7f881c0c1610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:14.206 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:14.198+0000 7f881b7fe700 1 -- 172.21.15.86:0/3484298340 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f881c14fc90 msgr2=0x7f881c0c1610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:14.206 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:14.198+0000 7f881b7fe700 1 --2- 172.21.15.86:0/3484298340 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f881c14fc90 0x7f881c0c1610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:14.206 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:14.198+0000 7f881b7fe700 1 -- 172.21.15.86:0/3484298340 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f881c0bd220 msgr2=0x7f881c0a7b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:14.206 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:14.198+0000 7f881b7fe700 1 --2- 172.21.15.86:0/3484298340 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f881c0bd220 0x7f881c0a7b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:14.206 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:14.198+0000 7f881b7fe700 1 -- 172.21.15.86:0/3484298340 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f880c009550 con 0x7f881c0c2860 2023-03-06T13:49:14.206 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:14.198+0000 7f8820874700 1 --2- 172.21.15.86:0/3484298340 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f881c14fc90 0x7f881c0c1610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-06T13:49:14.206 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:14.198+0000 7f881b7fe700 1 --2- 172.21.15.86:0/3484298340 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f881c0c2860 0x7f881c144f40 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f880c014040 tx=0x7f880c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T13:49:14.206 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:14.198+0000 7f8818ff9700 1 -- 172.21.15.86:0/3484298340 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f880c004310 con 0x7f881c0c2860 2023-03-06T13:49:14.207 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:14.198+0000 7f8818ff9700 1 -- 172.21.15.86:0/3484298340 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f880c01e070 con 0x7f881c0c2860 2023-03-06T13:49:14.207 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:14.198+0000 7f88222d7700 1 -- 172.21.15.86:0/3484298340 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f881c0bda50 con 0x7f881c0c2860 2023-03-06T13:49:14.207 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:14.198+0000 7f8818ff9700 1 -- 172.21.15.86:0/3484298340 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f880c0036a0 con 0x7f881c0c2860 2023-03-06T13:49:14.207 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:14.198+0000 7f88222d7700 1 -- 172.21.15.86:0/3484298340 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f881c0bd770 con 0x7f881c0c2860 2023-03-06T13:49:14.207 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:14.199+0000 7f88222d7700 1 -- 172.21.15.86:0/3484298340 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f881c0bdd30 con 0x7f881c0c2860 2023-03-06T13:49:14.207 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:14.199+0000 7f8818ff9700 1 -- 172.21.15.86:0/3484298340 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f880c029020 con 0x7f881c0c2860 2023-03-06T13:49:14.208 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:14.200+0000 7f8818ff9700 1 --2- 172.21.15.86:0/3484298340 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7f88080682f0 0x7f880806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:14.208 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:14.200+0000 7f8818ff9700 1 -- 172.21.15.86:0/3484298340 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f880c086e10 con 0x7f881c0c2860 2023-03-06T13:49:14.208 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:14.200+0000 7f881bfff700 1 --2- 172.21.15.86:0/3484298340 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7f88080682f0 0x7f880806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:14.208 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:14.200+0000 7f881bfff700 1 --2- 172.21.15.86:0/3484298340 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7f88080682f0 0x7f880806a7a0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f881000ab70 tx=0x7f8810008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T13:49:14.209 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:14.204+0000 7f8818ff9700 1 -- 172.21.15.86:0/3484298340 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f880c053670 con 0x7f881c0c2860 2023-03-06T13:49:14.388 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:14.386+0000 7f88222d7700 1 -- 172.21.15.86:0/3484298340 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f881c04e750 con 0x7f881c0c2860 2023-03-06T13:49:14.389 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:14.387+0000 7f8818ff9700 1 -- 172.21.15.86:0/3484298340 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+17824 (secure 0 0 0) 0x7f880c056c90 con 0x7f881c0c2860 2023-03-06T13:49:14.389 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-03-06T13:49:14.390 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":22,"fsid":"2cca6c77-50cb-47d8-a8c7-444575d01327","created":"2023-03-06T13:48:48.337369+0000","modified":"2023-03-06T13:49:13.706339+0000","last_up_change":"2023-03-06T13:48:59.782729+0000","last_in_change":"2023-03-06T13:48:50.777249+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-03-06T13:48:59.879087+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-03-06T13:49:06.686394+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-03-06T13:49:11.362997+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-03-06T13:49:12.753969+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2de68e69-e10f-49e1-a15a-8a9bfff504c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":96739},{"type":"v1","addr":"172.21.15.86:6816","nonce":96739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":96739},{"type":"v1","addr":"172.21.15.86:6819","nonce":96739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":96739},{"type":"v1","addr":"172.21.15.86:6823","nonce":96739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":96739},{"type":"v1","addr":"172.21.15.86:6821","nonce":96739}]},"public_addr":"172.21.15.86:6816/96739","cluster_addr":"172.21.15.86:6819/96739","heartbeat_back_addr":"172.21.15.86:6823/96739","heartbeat_front_addr":"172.21.15.86:6821/96739","state":["exists","up"]},{"osd":1,"uuid":"3e75c061-0de5-4742-a20d-4b5a4adb9b81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":96738},{"type":"v1","addr":"172.21.15.86:6801","nonce":96738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":96738},{"type":"v1","addr":"172.21.15.86:6803","nonce":96738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":96738},{"type":"v1","addr":"172.21.15.86:6807","nonce":96738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":96738},{"type":"v1","addr":"172.21.15.86:6805","nonce":96738}]},"public_addr":"172.21.15.86:6801/96738","cluster_addr":"172.21.15.86:6803/96738","heartbeat_back_addr":"172.21.15.86:6807/96738","heartbeat_front_addr":"172.21.15.86:6805/96738","state":["exists","up"]},{"osd":2,"uuid":"38d71bce-81c2-4e33-91e1-65efb08f2291","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":96740},{"type":"v1","addr":"172.21.15.86:6809","nonce":96740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":96740},{"type":"v1","addr":"172.21.15.86:6811","nonce":96740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6815","nonce":96740},{"type":"v1","addr":"172.21.15.86:6817","nonce":96740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":96740},{"type":"v1","addr":"172.21.15.86:6813","nonce":96740}]},"public_addr":"172.21.15.86:6809/96740","cluster_addr":"172.21.15.86:6811/96740","heartbeat_back_addr":"172.21.15.86:6817/96740","heartbeat_front_addr":"172.21.15.86:6813/96740","state":["exists","up"]},{"osd":3,"uuid":"d95a2686-21bd-4b66-9ea5-eef65403935b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":96756},{"type":"v1","addr":"172.21.15.86:6825","nonce":96756}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":96756},{"type":"v1","addr":"172.21.15.86:6827","nonce":96756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":96756},{"type":"v1","addr":"172.21.15.86:6831","nonce":96756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":96756},{"type":"v1","addr":"172.21.15.86:6829","nonce":96756}]},"public_addr":"172.21.15.86:6825/96756","cluster_addr":"172.21.15.86:6827/96756","heartbeat_back_addr":"172.21.15.86:6831/96756","heartbeat_front_addr":"172.21.15.86:6829/96756","state":["exists","up"]},{"osd":4,"uuid":"98c7e359-0f00-496a-8aaa-5472af355e48","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.202:6816","nonce":96847},{"type":"v1","addr":"172.21.15.202:6817","nonce":96847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.202:6818","nonce":96847},{"type":"v1","addr":"172.21.15.202:6819","nonce":96847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.202:6822","nonce":96847},{"type":"v1","addr":"172.21.15.202:6823","nonce":96847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.202:6820","nonce":96847},{"type":"v1","addr":"172.21.15.202:6821","nonce":96847}]},"public_addr":"172.21.15.202:6817/96847","cluster_addr":"172.21.15.202:6819/96847","heartbeat_back_addr":"172.21.15.202:6823/96847","heartbeat_front_addr":"172.21.15.202:6821/96847","state":["exists","up"]},{"osd":5,"uuid":"fa6688d9-73f3-4593-a50e-d96a0fe5f4cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.202:6824","nonce":96848},{"type":"v1","addr":"172.21.15.202:6825","nonce":96848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.202:6826","nonce":96848},{"type":"v1","addr":"172.21.15.202:6827","nonce":96848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.202:6830","nonce":96848},{"type":"v1","addr":"172.21.15.202:6831","nonce":96848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.202:6828","nonce":96848},{"type":"v1","addr":"172.21.15.202:6829","nonce":96848}]},"public_addr":"172.21.15.202:6825/96848","cluster_addr":"172.21.15.202:6827/96848","heartbeat_back_addr":"172.21.15.202:6831/96848","heartbeat_front_addr":"172.21.15.202:6829/96848","state":["exists","up"]},{"osd":6,"uuid":"7bfc6dc0-2388-4498-9cd7-766e3606f6a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.202:6808","nonce":96845},{"type":"v1","addr":"172.21.15.202:6809","nonce":96845}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.202:6810","nonce":96845},{"type":"v1","addr":"172.21.15.202:6811","nonce":96845}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.202:6814","nonce":96845},{"type":"v1","addr":"172.21.15.202:6815","nonce":96845}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.202:6812","nonce":96845},{"type":"v1","addr":"172.21.15.202:6813","nonce":96845}]},"public_addr":"172.21.15.202:6809/96845","cluster_addr":"172.21.15.202:6811/96845","heartbeat_back_addr":"172.21.15.202:6815/96845","heartbeat_front_addr":"172.21.15.202:6813/96845","state":["exists","up"]},{"osd":7,"uuid":"c475f863-96fd-48e3-8033-7d1c3b1d503f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.202:6800","nonce":96846},{"type":"v1","addr":"172.21.15.202:6801","nonce":96846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.202:6802","nonce":96846},{"type":"v1","addr":"172.21.15.202:6803","nonce":96846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.202:6806","nonce":96846},{"type":"v1","addr":"172.21.15.202:6807","nonce":96846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.202:6804","nonce":96846},{"type":"v1","addr":"172.21.15.202:6805","nonce":96846}]},"public_addr":"172.21.15.202:6801/96846","cluster_addr":"172.21.15.202:6803/96846","heartbeat_back_addr":"172.21.15.202:6807/96846","heartbeat_front_addr":"172.21.15.202:6805/96846","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-06T13:48:55.997991+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-06T13:48:55.930805+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-06T13:48:56.000312+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-06T13:48:55.998360+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-06T13:48:56.052762+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-06T13:48:56.036049+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-06T13:48:56.048751+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-06T13:48:56.011928+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-03-06T13:49:14.391 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:14.389+0000 7f88222d7700 1 -- 172.21.15.86:0/3484298340 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7f88080682f0 msgr2=0x7f880806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:14.392 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:14.389+0000 7f88222d7700 1 --2- 172.21.15.86:0/3484298340 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7f88080682f0 0x7f880806a7a0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f881000ab70 tx=0x7f8810008040 comp rx=0 tx=0).stop 2023-03-06T13:49:14.392 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:14.389+0000 7f88222d7700 1 -- 172.21.15.86:0/3484298340 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f881c0c2860 msgr2=0x7f881c144f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:14.392 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:14.389+0000 7f88222d7700 1 --2- 172.21.15.86:0/3484298340 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f881c0c2860 0x7f881c144f40 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f880c014040 tx=0x7f880c004750 comp rx=0 tx=0).stop 2023-03-06T13:49:14.392 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:14.389+0000 7f88222d7700 1 -- 172.21.15.86:0/3484298340 shutdown_connections 2023-03-06T13:49:14.393 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:14.389+0000 7f88222d7700 1 --2- 172.21.15.86:0/3484298340 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7f88080682f0 0x7f880806a7a0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:14.393 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:14.389+0000 7f88222d7700 1 --2- 172.21.15.86:0/3484298340 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f881c14fc90 0x7f881c0c1610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:14.393 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:14.389+0000 7f88222d7700 1 --2- 172.21.15.86:0/3484298340 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f881c0bd220 0x7f881c0a7b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:14.394 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:14.389+0000 7f88222d7700 1 --2- 172.21.15.86:0/3484298340 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f881c0c2860 0x7f881c144f40 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:14.394 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:14.389+0000 7f88222d7700 1 -- 172.21.15.86:0/3484298340 >> 172.21.15.86:0/3484298340 conn(0x7f881c06c0d0 msgr2=0x7f881c1d7210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T13:49:14.394 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:14.389+0000 7f88222d7700 1 -- 172.21.15.86:0/3484298340 shutdown_connections 2023-03-06T13:49:14.394 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:14.389+0000 7f88222d7700 1 -- 172.21.15.86:0/3484298340 wait complete. 2023-03-06T13:49:14.404 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-03-06T13:49:14.526 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:14.524+0000 7f89815ab700 1 Processor -- start 2023-03-06T13:49:14.526 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:14.524+0000 7f89815ab700 1 -- start start 2023-03-06T13:49:14.528 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:14.525+0000 7f89815ab700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f897c0bd670 0x7f897c0c09a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:14.528 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:14.525+0000 7f89815ab700 1 --2- >> v2:172.21.15.202:3300/0 conn(0x7f897c06d9a0 0x7f897c06ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:14.528 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:14.525+0000 7f89815ab700 1 -- --> v1:172.21.15.202:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f897c0c1060 con 0x7f897c14f3f0 2023-03-06T13:49:14.529 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:14.525+0000 7f89815ab700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f897c06d630 con 0x7f897c0bd670 2023-03-06T13:49:14.529 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:14.525+0000 7f89815ab700 1 -- --> v2:172.21.15.202:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f897c06cc90 con 0x7f897c06d9a0 2023-03-06T13:49:14.529 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:14.525+0000 7f897affd700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f897c0bd670 0x7f897c0c09a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:14.529 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:14.525+0000 7f897affd700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f897c0bd670 0x7f897c0c09a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:38588/0 (socket says 172.21.15.86:38588) 2023-03-06T13:49:14.529 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:14.525+0000 7f897affd700 1 -- 172.21.15.86:0/2195857799 learned_addr learned my addr 172.21.15.86:0/2195857799 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-03-06T13:49:14.529 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:14.525+0000 7f897a7fc700 1 --2- 172.21.15.86:0/2195857799 >> v2:172.21.15.202:3300/0 conn(0x7f897c06d9a0 0x7f897c06ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:14.529 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:14.525+0000 7f897affd700 1 -- 172.21.15.86:0/2195857799 >> v2:172.21.15.202:3300/0 conn(0x7f897c06d9a0 msgr2=0x7f897c06ddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T13:49:14.530 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:14.525+0000 7f897affd700 1 --2- 172.21.15.86:0/2195857799 >> v2:172.21.15.202:3300/0 conn(0x7f897c06d9a0 0x7f897c06ddf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:14.530 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:14.525+0000 7f897affd700 1 -- 172.21.15.86:0/2195857799 >> v1:172.21.15.202:6789/0 conn(0x7f897c14f3f0 legacy=0x7f897c14f870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T13:49:14.530 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:14.525+0000 7f897affd700 1 -- 172.21.15.86:0/2195857799 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f897c06cf70 con 0x7f897c0bd670 2023-03-06T13:49:14.530 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:14.525+0000 7f897affd700 1 --2- 172.21.15.86:0/2195857799 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f897c0bd670 0x7f897c0c09a0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f897c06f9e0 tx=0x7f8970009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4980487b642d7831 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T13:49:14.530 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:14.526+0000 7f8979ffb700 1 -- 172.21.15.86:0/2195857799 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8970004230 con 0x7f897c0bd670 2023-03-06T13:49:14.530 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:14.526+0000 7f8979ffb700 1 -- 172.21.15.86:0/2195857799 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8970004390 con 0x7f897c0bd670 2023-03-06T13:49:14.530 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:14.526+0000 7f8979ffb700 1 -- 172.21.15.86:0/2195857799 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89700036a0 con 0x7f897c0bd670 2023-03-06T13:49:14.530 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:14.526+0000 7f89815ab700 1 -- 172.21.15.86:0/2195857799 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f897c0bd670 msgr2=0x7f897c0c09a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:14.531 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:14.526+0000 7f89815ab700 1 --2- 172.21.15.86:0/2195857799 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f897c0bd670 0x7f897c0c09a0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f897c06f9e0 tx=0x7f8970009bd0 comp rx=0 tx=0).stop 2023-03-06T13:49:14.531 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:14.526+0000 7f89815ab700 1 -- 172.21.15.86:0/2195857799 shutdown_connections 2023-03-06T13:49:14.531 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:14.526+0000 7f89815ab700 1 --2- 172.21.15.86:0/2195857799 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f897c0bd670 0x7f897c0c09a0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:14.531 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:14.526+0000 7f89815ab700 1 --2- 172.21.15.86:0/2195857799 >> v2:172.21.15.202:3300/0 conn(0x7f897c06d9a0 0x7f897c06ddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:14.531 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:14.526+0000 7f89815ab700 1 -- 172.21.15.86:0/2195857799 >> 172.21.15.86:0/2195857799 conn(0x7f897c0c1900 msgr2=0x7f897c0c1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T13:49:14.531 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:14.526+0000 7f89815ab700 1 -- 172.21.15.86:0/2195857799 shutdown_connections 2023-03-06T13:49:14.531 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:14.526+0000 7f89815ab700 1 -- 172.21.15.86:0/2195857799 wait complete. 2023-03-06T13:49:14.534 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:14.527+0000 7f89815ab700 1 Processor -- start 2023-03-06T13:49:14.534 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:14.528+0000 7f89815ab700 1 -- start start 2023-03-06T13:49:14.534 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:14.528+0000 7f89815ab700 1 --2- >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f897c06d9a0 0x7f897c070f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:14.534 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:14.528+0000 7f89815ab700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f897c0bd670 0x7f897c071490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:14.534 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:14.528+0000 7f89815ab700 1 --2- >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f897c14f3f0 0x7f897c144b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:14.534 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:14.528+0000 7f89815ab700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f897c1e87d0 con 0x7f897c0bd670 2023-03-06T13:49:14.534 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:14.528+0000 7f89815ab700 1 -- --> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f897c0707c0 con 0x7f897c14f3f0 2023-03-06T13:49:14.535 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:14.528+0000 7f89815ab700 1 -- --> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f897c0a70e0 con 0x7f897c06d9a0 2023-03-06T13:49:14.535 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:14.528+0000 7f897a7fc700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f897c0bd670 0x7f897c071490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:14.535 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:14.528+0000 7f897a7fc700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f897c0bd670 0x7f897c071490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:38596/0 (socket says 172.21.15.86:38596) 2023-03-06T13:49:14.535 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:14.528+0000 7f897a7fc700 1 -- 172.21.15.86:0/993762553 learned_addr learned my addr 172.21.15.86:0/993762553 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-03-06T13:49:14.536 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:14.528+0000 7f897affd700 1 --2- 172.21.15.86:0/993762553 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f897c06d9a0 0x7f897c070f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:14.536 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:14.528+0000 7f897b7fe700 1 --2- 172.21.15.86:0/993762553 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f897c14f3f0 0x7f897c144b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:14.537 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:14.529+0000 7f897a7fc700 1 -- 172.21.15.86:0/993762553 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f897c06d9a0 msgr2=0x7f897c070f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:14.537 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:14.529+0000 7f897a7fc700 1 --2- 172.21.15.86:0/993762553 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f897c06d9a0 0x7f897c070f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:14.537 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:14.529+0000 7f897a7fc700 1 -- 172.21.15.86:0/993762553 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f897c14f3f0 msgr2=0x7f897c144b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:14.537 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:14.529+0000 7f897a7fc700 1 --2- 172.21.15.86:0/993762553 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f897c14f3f0 0x7f897c144b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:14.537 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:14.529+0000 7f897a7fc700 1 -- 172.21.15.86:0/993762553 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8970009550 con 0x7f897c0bd670 2023-03-06T13:49:14.537 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:14.529+0000 7f897a7fc700 1 --2- 172.21.15.86:0/993762553 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f897c0bd670 0x7f897c071490 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f896c00e840 tx=0x7f896c00ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T13:49:14.537 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:14.529+0000 7f89637fe700 1 -- 172.21.15.86:0/993762553 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f896c013610 con 0x7f897c0bd670 2023-03-06T13:49:14.538 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:14.529+0000 7f89637fe700 1 -- 172.21.15.86:0/993762553 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f896c013770 con 0x7f897c0bd670 2023-03-06T13:49:14.538 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:14.529+0000 7f89815ab700 1 -- 172.21.15.86:0/993762553 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f897c0728d0 con 0x7f897c0bd670 2023-03-06T13:49:14.538 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:14.529+0000 7f89637fe700 1 -- 172.21.15.86:0/993762553 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f896c013b20 con 0x7f897c0bd670 2023-03-06T13:49:14.538 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:14.529+0000 7f89815ab700 1 -- 172.21.15.86:0/993762553 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f897c06d250 con 0x7f897c0bd670 2023-03-06T13:49:14.538 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:14.530+0000 7f89815ab700 1 -- 172.21.15.86:0/993762553 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f897c0bdf90 con 0x7f897c0bd670 2023-03-06T13:49:14.538 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:14.530+0000 7f89637fe700 1 -- 172.21.15.86:0/993762553 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f896c023070 con 0x7f897c0bd670 2023-03-06T13:49:14.538 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:14.531+0000 7f89637fe700 1 --2- 172.21.15.86:0/993762553 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7f89680682f0 0x7f896806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:14.539 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:14.531+0000 7f89637fe700 1 -- 172.21.15.86:0/993762553 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f896c085990 con 0x7f897c0bd670 2023-03-06T13:49:14.539 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:14.531+0000 7f897affd700 1 --2- 172.21.15.86:0/993762553 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7f89680682f0 0x7f896806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:14.539 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:14.531+0000 7f897affd700 1 --2- 172.21.15.86:0/993762553 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7f89680682f0 0x7f896806a7a0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f8970009130 tx=0x7f8970008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T13:49:14.539 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:14.535+0000 7f89637fe700 1 -- 172.21.15.86:0/993762553 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f896c0521f0 con 0x7f897c0bd670 2023-03-06T13:49:14.763 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:14.761+0000 7f89815ab700 1 -- 172.21.15.86:0/993762553 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f897c04e750 con 0x7f897c0bd670 2023-03-06T13:49:15.720 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:15.718+0000 7f89637fe700 1 -- 172.21.15.86:0/993762553 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) v1 ==== 118+0+0 (secure 0 0 0) 0x7f896c055810 con 0x7f897c0bd670 2023-03-06T13:49:15.723 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:15.721+0000 7f89815ab700 1 -- 172.21.15.86:0/993762553 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7f89680682f0 msgr2=0x7f896806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:15.724 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:15.721+0000 7f89815ab700 1 --2- 172.21.15.86:0/993762553 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7f89680682f0 0x7f896806a7a0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f8970009130 tx=0x7f8970008030 comp rx=0 tx=0).stop 2023-03-06T13:49:15.724 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:15.721+0000 7f89815ab700 1 -- 172.21.15.86:0/993762553 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f897c0bd670 msgr2=0x7f897c071490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:15.724 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:15.721+0000 7f89815ab700 1 --2- 172.21.15.86:0/993762553 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f897c0bd670 0x7f897c071490 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f896c00e840 tx=0x7f896c00ec00 comp rx=0 tx=0).stop 2023-03-06T13:49:15.724 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:15.721+0000 7f89815ab700 1 -- 172.21.15.86:0/993762553 shutdown_connections 2023-03-06T13:49:15.725 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:15.721+0000 7f89815ab700 1 --2- 172.21.15.86:0/993762553 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7f89680682f0 0x7f896806a7a0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:15.725 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:15.721+0000 7f89815ab700 1 --2- 172.21.15.86:0/993762553 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f897c14f3f0 0x7f897c144b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:15.725 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:15.721+0000 7f89815ab700 1 --2- 172.21.15.86:0/993762553 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f897c06d9a0 0x7f897c070f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:15.725 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:15.721+0000 7f89815ab700 1 --2- 172.21.15.86:0/993762553 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f897c0bd670 0x7f897c071490 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:15.726 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:15.721+0000 7f89815ab700 1 -- 172.21.15.86:0/993762553 >> 172.21.15.86:0/993762553 conn(0x7f897c0c1900 msgr2=0x7f897c0a23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T13:49:15.726 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:15.721+0000 7f89815ab700 1 -- 172.21.15.86:0/993762553 shutdown_connections 2023-03-06T13:49:15.726 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:15.721+0000 7f89815ab700 1 -- 172.21.15.86:0/993762553 wait complete. 2023-03-06T13:49:15.738 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-03-06T13:49:15.739 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-03-06T13:49:15.868 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:15.866+0000 7f3d79621700 1 Processor -- start 2023-03-06T13:49:15.869 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:15.866+0000 7f3d79621700 1 -- start start 2023-03-06T13:49:15.871 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:15.867+0000 7f3d79621700 1 --2- >> v2:172.21.15.202:3300/0 conn(0x7f3d74149420 0x7f3d740c2860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:15.871 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:15.867+0000 7f3d79621700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f3d7406ea90 0x7f3d74159a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:15.871 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:15.867+0000 7f3d79621700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d74153340 con 0x7f3d740c2da0 2023-03-06T13:49:15.871 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:15.867+0000 7f3d79621700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d741497f0 con 0x7f3d7406ea90 2023-03-06T13:49:15.871 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:15.867+0000 7f3d79621700 1 -- --> v2:172.21.15.202:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d74152750 con 0x7f3d74149420 2023-03-06T13:49:15.872 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:15.867+0000 7f3d727fc700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f3d740c2da0 0x7f3d7414f0c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:48750/0 (socket says 172.21.15.86:48750) 2023-03-06T13:49:15.872 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:15.867+0000 7f3d727fc700 1 -- 172.21.15.86:0/2755912656 learned_addr learned my addr 172.21.15.86:0/2755912656 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-03-06T13:49:15.872 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:15.867+0000 7f3d737fe700 1 --2- 172.21.15.86:0/2755912656 >> v2:172.21.15.86:3300/0 conn(0x7f3d7406ea90 0x7f3d74159a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:15.872 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:15.867+0000 7f3d71ffb700 1 -- 172.21.15.86:0/2755912656 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 316258392 0 0) 0x7f3d74153340 con 0x7f3d740c2da0 2023-03-06T13:49:15.872 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:15.868+0000 7f3d71ffb700 1 -- 172.21.15.86:0/2755912656 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3d5c0035b0 con 0x7f3d740c2da0 2023-03-06T13:49:15.872 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:15.868+0000 7f3d72ffd700 1 --2- 172.21.15.86:0/2755912656 >> v2:172.21.15.202:3300/0 conn(0x7f3d74149420 0x7f3d740c2860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:15.872 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:15.868+0000 7f3d737fe700 1 -- 172.21.15.86:0/2755912656 >> v2:172.21.15.202:3300/0 conn(0x7f3d74149420 msgr2=0x7f3d740c2860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T13:49:15.872 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:15.868+0000 7f3d737fe700 1 --2- 172.21.15.86:0/2755912656 >> v2:172.21.15.202:3300/0 conn(0x7f3d74149420 0x7f3d740c2860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:15.873 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:15.868+0000 7f3d737fe700 1 -- 172.21.15.86:0/2755912656 >> v1:172.21.15.86:6789/0 conn(0x7f3d740c2da0 legacy=0x7f3d7414f0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:15.873 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:15.868+0000 7f3d737fe700 1 -- 172.21.15.86:0/2755912656 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d74152a10 con 0x7f3d7406ea90 2023-03-06T13:49:15.873 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:15.868+0000 7f3d72ffd700 1 --2- 172.21.15.86:0/2755912656 >> v2:172.21.15.202:3300/0 conn(0x7f3d74149420 0x7f3d740c2860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-06T13:49:15.873 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:15.868+0000 7f3d737fe700 1 --2- 172.21.15.86:0/2755912656 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3d7406ea90 0x7f3d74159a40 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f3d74067e40 tx=0x7f3d6c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=634ebf22009353f0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T13:49:15.873 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:15.868+0000 7f3d71ffb700 1 -- 172.21.15.86:0/2755912656 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d6c00e070 con 0x7f3d7406ea90 2023-03-06T13:49:15.873 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:15.868+0000 7f3d71ffb700 1 -- 172.21.15.86:0/2755912656 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d6c00bb20 con 0x7f3d7406ea90 2023-03-06T13:49:15.874 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:15.868+0000 7f3d71ffb700 1 -- 172.21.15.86:0/2755912656 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d6c012430 con 0x7f3d7406ea90 2023-03-06T13:49:15.874 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:15.868+0000 7f3d79621700 1 -- 172.21.15.86:0/2755912656 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3d7406ea90 msgr2=0x7f3d74159a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:15.874 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:15.868+0000 7f3d79621700 1 --2- 172.21.15.86:0/2755912656 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3d7406ea90 0x7f3d74159a40 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f3d74067e40 tx=0x7f3d6c00b330 comp rx=0 tx=0).stop 2023-03-06T13:49:15.874 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:15.868+0000 7f3d79621700 1 -- 172.21.15.86:0/2755912656 shutdown_connections 2023-03-06T13:49:15.874 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:15.868+0000 7f3d79621700 1 --2- 172.21.15.86:0/2755912656 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3d7406ea90 0x7f3d74159a40 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:15.874 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:15.868+0000 7f3d79621700 1 --2- 172.21.15.86:0/2755912656 >> v2:172.21.15.202:3300/0 conn(0x7f3d74149420 0x7f3d740c2860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:15.874 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:15.868+0000 7f3d79621700 1 -- 172.21.15.86:0/2755912656 >> 172.21.15.86:0/2755912656 conn(0x7f3d7406c0d0 msgr2=0x7f3d740c2150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T13:49:15.874 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:15.868+0000 7f3d79621700 1 -- 172.21.15.86:0/2755912656 shutdown_connections 2023-03-06T13:49:15.875 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:15.868+0000 7f3d79621700 1 -- 172.21.15.86:0/2755912656 wait complete. 2023-03-06T13:49:15.877 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:15.870+0000 7f3d79621700 1 Processor -- start 2023-03-06T13:49:15.877 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:15.870+0000 7f3d79621700 1 -- start start 2023-03-06T13:49:15.878 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:15.870+0000 7f3d79621700 1 --2- >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f3d7406ea90 0x7f3d7414c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:15.878 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:15.870+0000 7f3d79621700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3d740c2da0 0x7f3d74151850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:15.878 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:15.870+0000 7f3d79621700 1 --2- >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f3d74149420 0x7f3d7414b440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:15.878 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:15.870+0000 7f3d79621700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d74151d90 con 0x7f3d740c2da0 2023-03-06T13:49:15.878 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:15.870+0000 7f3d79621700 1 -- --> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d7414c8c0 con 0x7f3d7406ea90 2023-03-06T13:49:15.878 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:15.870+0000 7f3d79621700 1 -- --> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d7414a6a0 con 0x7f3d74149420 2023-03-06T13:49:15.879 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:15.870+0000 7f3d727fc700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3d740c2da0 0x7f3d74151850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:15.879 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:15.871+0000 7f3d727fc700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3d740c2da0 0x7f3d74151850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:38610/0 (socket says 172.21.15.86:38610) 2023-03-06T13:49:15.879 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:15.871+0000 7f3d727fc700 1 -- 172.21.15.86:0/94854226 learned_addr learned my addr 172.21.15.86:0/94854226 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-03-06T13:49:15.879 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:15.871+0000 7f3d72ffd700 1 --2- 172.21.15.86:0/94854226 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f3d7406ea90 0x7f3d7414c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:15.879 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:15.871+0000 7f3d737fe700 1 --2- 172.21.15.86:0/94854226 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f3d74149420 0x7f3d7414b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:15.879 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:15.871+0000 7f3d727fc700 1 -- 172.21.15.86:0/94854226 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f3d74149420 msgr2=0x7f3d7414b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:15.879 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:15.871+0000 7f3d727fc700 1 --2- 172.21.15.86:0/94854226 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f3d74149420 0x7f3d7414b440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:15.880 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:15.871+0000 7f3d727fc700 1 -- 172.21.15.86:0/94854226 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f3d7406ea90 msgr2=0x7f3d7414c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:15.880 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:15.871+0000 7f3d727fc700 1 --2- 172.21.15.86:0/94854226 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f3d7406ea90 0x7f3d7414c2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:15.880 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:15.871+0000 7f3d727fc700 1 -- 172.21.15.86:0/94854226 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d6c009a70 con 0x7f3d740c2da0 2023-03-06T13:49:15.880 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:15.871+0000 7f3d737fe700 1 --2- 172.21.15.86:0/94854226 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f3d74149420 0x7f3d7414b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-06T13:49:15.880 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:15.871+0000 7f3d727fc700 1 --2- 172.21.15.86:0/94854226 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3d740c2da0 0x7f3d74151850 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f3d64005910 tx=0x7f3d6400ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T13:49:15.880 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:15.871+0000 7f3d5b7fe700 1 -- 172.21.15.86:0/94854226 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d64005d70 con 0x7f3d740c2da0 2023-03-06T13:49:15.880 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:15.871+0000 7f3d5b7fe700 1 -- 172.21.15.86:0/94854226 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d640070d0 con 0x7f3d740c2da0 2023-03-06T13:49:15.881 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:15.871+0000 7f3d79621700 1 -- 172.21.15.86:0/94854226 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d74152fd0 con 0x7f3d740c2da0 2023-03-06T13:49:15.881 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:15.871+0000 7f3d5b7fe700 1 -- 172.21.15.86:0/94854226 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d64007460 con 0x7f3d740c2da0 2023-03-06T13:49:15.881 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:15.871+0000 7f3d79621700 1 -- 172.21.15.86:0/94854226 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d74152cf0 con 0x7f3d740c2da0 2023-03-06T13:49:15.881 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:15.872+0000 7f3d79621700 1 -- 172.21.15.86:0/94854226 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d7406e610 con 0x7f3d740c2da0 2023-03-06T13:49:15.881 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:15.872+0000 7f3d5b7fe700 1 -- 172.21.15.86:0/94854226 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f3d64019030 con 0x7f3d740c2da0 2023-03-06T13:49:15.881 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:15.873+0000 7f3d5b7fe700 1 --2- 172.21.15.86:0/94854226 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7f3d600682f0 0x7f3d6006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:15.881 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:15.873+0000 7f3d72ffd700 1 --2- 172.21.15.86:0/94854226 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7f3d600682f0 0x7f3d6006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:15.881 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:15.873+0000 7f3d5b7fe700 1 -- 172.21.15.86:0/94854226 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3d64085130 con 0x7f3d740c2da0 2023-03-06T13:49:15.882 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:15.873+0000 7f3d72ffd700 1 --2- 172.21.15.86:0/94854226 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7f3d600682f0 0x7f3d6006a7a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f3d68006fd0 tx=0x7f3d68008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T13:49:15.882 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:15.877+0000 7f3d5b7fe700 1 -- 172.21.15.86:0/94854226 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f3d64051990 con 0x7f3d740c2da0 2023-03-06T13:49:16.107 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:16.105+0000 7f3d79621700 1 -- 172.21.15.86:0/94854226 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f3d7404e750 con 0x7f3d740c2da0 2023-03-06T13:49:16.727 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:16.725+0000 7f3d5b7fe700 1 -- 172.21.15.86:0/94854226 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) v1 ==== 122+0+0 (secure 0 0 0) 0x7f3d64054fb0 con 0x7f3d740c2da0 2023-03-06T13:49:16.729 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:16.727+0000 7f3d79621700 1 -- 172.21.15.86:0/94854226 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7f3d600682f0 msgr2=0x7f3d6006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:16.730 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:16.727+0000 7f3d79621700 1 --2- 172.21.15.86:0/94854226 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7f3d600682f0 0x7f3d6006a7a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f3d68006fd0 tx=0x7f3d68008040 comp rx=0 tx=0).stop 2023-03-06T13:49:16.730 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:16.727+0000 7f3d79621700 1 -- 172.21.15.86:0/94854226 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3d740c2da0 msgr2=0x7f3d74151850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:16.730 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:16.727+0000 7f3d79621700 1 --2- 172.21.15.86:0/94854226 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3d740c2da0 0x7f3d74151850 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f3d64005910 tx=0x7f3d6400ca90 comp rx=0 tx=0).stop 2023-03-06T13:49:16.730 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:16.728+0000 7f3d79621700 1 -- 172.21.15.86:0/94854226 shutdown_connections 2023-03-06T13:49:16.730 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:16.728+0000 7f3d79621700 1 --2- 172.21.15.86:0/94854226 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7f3d600682f0 0x7f3d6006a7a0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:16.730 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:16.728+0000 7f3d79621700 1 --2- 172.21.15.86:0/94854226 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f3d74149420 0x7f3d7414b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:16.731 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:16.728+0000 7f3d79621700 1 --2- 172.21.15.86:0/94854226 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f3d7406ea90 0x7f3d7414c2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:16.731 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:16.728+0000 7f3d79621700 1 --2- 172.21.15.86:0/94854226 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3d740c2da0 0x7f3d74151850 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:16.731 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:16.728+0000 7f3d79621700 1 -- 172.21.15.86:0/94854226 >> 172.21.15.86:0/94854226 conn(0x7f3d7406c0d0 msgr2=0x7f3d740beea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T13:49:16.731 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:16.728+0000 7f3d79621700 1 -- 172.21.15.86:0/94854226 shutdown_connections 2023-03-06T13:49:16.731 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:16.728+0000 7f3d79621700 1 -- 172.21.15.86:0/94854226 wait complete. 2023-03-06T13:49:16.743 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-03-06T13:49:16.743 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-03-06T13:49:16.864 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:16.862+0000 7fc01871a700 1 Processor -- start 2023-03-06T13:49:16.865 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:16.862+0000 7fc01871a700 1 -- start start 2023-03-06T13:49:16.868 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:16.863+0000 7fc01871a700 1 --2- >> v2:172.21.15.202:3300/0 conn(0x7fc01006ea90 0x7fc01014f0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:16.868 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:16.863+0000 7fc01871a700 1 --2- >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fc01014f600 0x7fc010159a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:16.869 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:16.863+0000 7fc01871a700 1 -- --> v1:172.21.15.202:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc010153340 con 0x7fc010149420 2023-03-06T13:49:16.869 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:16.863+0000 7fc01871a700 1 -- --> v2:172.21.15.202:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0101497f0 con 0x7fc01006ea90 2023-03-06T13:49:16.869 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:16.863+0000 7fc01871a700 1 -- --> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc010152750 con 0x7fc01014f600 2023-03-06T13:49:16.869 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:16.864+0000 7fc016cb7700 1 --2- >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fc01014f600 0x7fc010159a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:16.870 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:16.864+0000 7fc015cb5700 1 --2- >> v2:172.21.15.202:3300/0 conn(0x7fc01006ea90 0x7fc01014f0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:16.870 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:16.864+0000 7fc016cb7700 1 --2- >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fc01014f600 0x7fc010159a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.202:3301/0 says I am v2:172.21.15.86:50314/0 (socket says 172.21.15.86:50314) 2023-03-06T13:49:16.870 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:16.864+0000 7fc016cb7700 1 -- 172.21.15.86:0/1797635353 learned_addr learned my addr 172.21.15.86:0/1797635353 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-03-06T13:49:16.870 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:16.864+0000 7fc016cb7700 1 -- 172.21.15.86:0/1797635353 >> v2:172.21.15.202:3300/0 conn(0x7fc01006ea90 msgr2=0x7fc01014f0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T13:49:16.871 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:16.864+0000 7fc016cb7700 1 --2- 172.21.15.86:0/1797635353 >> v2:172.21.15.202:3300/0 conn(0x7fc01006ea90 0x7fc01014f0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:16.871 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:16.864+0000 7fc016cb7700 1 -- 172.21.15.86:0/1797635353 >> v1:172.21.15.202:6789/0 conn(0x7fc010149420 legacy=0x7fc0100c2860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:16.871 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:16.864+0000 7fc016cb7700 1 -- 172.21.15.86:0/1797635353 --> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc010152a10 con 0x7fc01014f600 2023-03-06T13:49:16.872 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:16.864+0000 7fc015cb5700 1 --2- 172.21.15.86:0/1797635353 >> v2:172.21.15.202:3300/0 conn(0x7fc01006ea90 0x7fc01014f0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-06T13:49:16.872 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:16.864+0000 7fc016cb7700 1 --2- 172.21.15.86:0/1797635353 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fc01014f600 0x7fc010159a40 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fc008009e50 tx=0x7fc00800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=83d577aad7f3298e server_cookie=0 in_seq=0 out_seq=0 2023-03-06T13:49:16.872 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:16.864+0000 7fc0154b4700 1 -- 172.21.15.86:0/1797635353 <== mon.2 v2:172.21.15.202:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc00800e070 con 0x7fc01014f600 2023-03-06T13:49:16.873 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:16.864+0000 7fc0154b4700 1 -- 172.21.15.86:0/1797635353 <== mon.2 v2:172.21.15.202:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc00800b910 con 0x7fc01014f600 2023-03-06T13:49:16.873 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:16.864+0000 7fc0154b4700 1 -- 172.21.15.86:0/1797635353 <== mon.2 v2:172.21.15.202:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc00800bcc0 con 0x7fc01014f600 2023-03-06T13:49:16.873 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:16.865+0000 7fc01871a700 1 -- 172.21.15.86:0/1797635353 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fc01014f600 msgr2=0x7fc010159a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:16.873 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:16.865+0000 7fc01871a700 1 --2- 172.21.15.86:0/1797635353 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fc01014f600 0x7fc010159a40 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fc008009e50 tx=0x7fc00800b330 comp rx=0 tx=0).stop 2023-03-06T13:49:16.874 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:16.865+0000 7fc01871a700 1 -- 172.21.15.86:0/1797635353 shutdown_connections 2023-03-06T13:49:16.874 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:16.865+0000 7fc01871a700 1 --2- 172.21.15.86:0/1797635353 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fc01014f600 0x7fc010159a40 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:16.874 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:16.865+0000 7fc01871a700 1 --2- 172.21.15.86:0/1797635353 >> v2:172.21.15.202:3300/0 conn(0x7fc01006ea90 0x7fc01014f0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:16.875 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:16.865+0000 7fc01871a700 1 -- 172.21.15.86:0/1797635353 >> 172.21.15.86:0/1797635353 conn(0x7fc01006c0d0 msgr2=0x7fc0100c2150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T13:49:16.875 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:16.865+0000 7fc01871a700 1 -- 172.21.15.86:0/1797635353 shutdown_connections 2023-03-06T13:49:16.875 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:16.865+0000 7fc01871a700 1 -- 172.21.15.86:0/1797635353 wait complete. 2023-03-06T13:49:16.875 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:16.866+0000 7fc01871a700 1 Processor -- start 2023-03-06T13:49:16.875 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:16.866+0000 7fc01871a700 1 -- start start 2023-03-06T13:49:16.879 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:16.867+0000 7fc01871a700 1 --2- >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7fc01006ea90 0x7fc0100a53e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:16.879 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:16.867+0000 7fc01871a700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc010149420 0x7fc0100a76e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:16.879 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:16.867+0000 7fc01871a700 1 --2- >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fc01014f600 0x7fc0101e8900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:16.880 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:16.867+0000 7fc01871a700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0101e6090 con 0x7fc010149420 2023-03-06T13:49:16.880 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:16.867+0000 7fc01871a700 1 -- --> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0100a5920 con 0x7fc01006ea90 2023-03-06T13:49:16.880 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:16.867+0000 7fc01871a700 1 -- --> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0101e5150 con 0x7fc01014f600 2023-03-06T13:49:16.881 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:16.867+0000 7fc015cb5700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc010149420 0x7fc0100a76e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:16.881 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:16.867+0000 7fc015cb5700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc010149420 0x7fc0100a76e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:38624/0 (socket says 172.21.15.86:38624) 2023-03-06T13:49:16.881 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:16.867+0000 7fc015cb5700 1 -- 172.21.15.86:0/1152541741 learned_addr learned my addr 172.21.15.86:0/1152541741 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-03-06T13:49:16.881 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:16.867+0000 7fc016cb7700 1 --2- 172.21.15.86:0/1152541741 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fc01014f600 0x7fc0101e8900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:16.882 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:16.867+0000 7fc0164b6700 1 --2- 172.21.15.86:0/1152541741 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7fc01006ea90 0x7fc0100a53e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:16.882 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:16.867+0000 7fc015cb5700 1 -- 172.21.15.86:0/1152541741 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fc01014f600 msgr2=0x7fc0101e8900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:16.882 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:16.867+0000 7fc015cb5700 1 --2- 172.21.15.86:0/1152541741 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fc01014f600 0x7fc0101e8900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:16.882 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:16.867+0000 7fc015cb5700 1 -- 172.21.15.86:0/1152541741 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7fc01006ea90 msgr2=0x7fc0100a53e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:16.883 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:16.867+0000 7fc015cb5700 1 --2- 172.21.15.86:0/1152541741 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7fc01006ea90 0x7fc0100a53e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:16.883 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:16.867+0000 7fc015cb5700 1 -- 172.21.15.86:0/1152541741 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc00c0094a0 con 0x7fc010149420 2023-03-06T13:49:16.883 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:16.867+0000 7fc016cb7700 1 --2- 172.21.15.86:0/1152541741 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fc01014f600 0x7fc0101e8900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-06T13:49:16.884 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:16.867+0000 7fc0164b6700 1 --2- 172.21.15.86:0/1152541741 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7fc01006ea90 0x7fc0100a53e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-06T13:49:16.884 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:16.867+0000 7fc015cb5700 1 --2- 172.21.15.86:0/1152541741 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc010149420 0x7fc0100a76e0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fc00c00ec10 tx=0x7fc00c009e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T13:49:16.884 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:16.867+0000 7fc006ffd700 1 -- 172.21.15.86:0/1152541741 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc00c00c8e0 con 0x7fc010149420 2023-03-06T13:49:16.884 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:16.867+0000 7fc006ffd700 1 -- 172.21.15.86:0/1152541741 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc00c00ca40 con 0x7fc010149420 2023-03-06T13:49:16.885 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:16.867+0000 7fc006ffd700 1 -- 172.21.15.86:0/1152541741 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc00c00cdd0 con 0x7fc010149420 2023-03-06T13:49:16.885 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:16.867+0000 7fc01871a700 1 -- 172.21.15.86:0/1152541741 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc008009b30 con 0x7fc010149420 2023-03-06T13:49:16.885 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:16.868+0000 7fc01871a700 1 -- 172.21.15.86:0/1152541741 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc010152fd0 con 0x7fc010149420 2023-03-06T13:49:16.886 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:16.868+0000 7fc01871a700 1 -- 172.21.15.86:0/1152541741 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc010152cf0 con 0x7fc010149420 2023-03-06T13:49:16.886 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:16.869+0000 7fc006ffd700 1 -- 172.21.15.86:0/1152541741 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fc00c019030 con 0x7fc010149420 2023-03-06T13:49:16.886 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:16.869+0000 7fc006ffd700 1 --2- 172.21.15.86:0/1152541741 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7fbff40682f0 0x7fbff406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:16.887 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:16.869+0000 7fc006ffd700 1 -- 172.21.15.86:0/1152541741 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc00c085c70 con 0x7fc010149420 2023-03-06T13:49:16.887 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:16.869+0000 7fc0164b6700 1 --2- 172.21.15.86:0/1152541741 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7fbff40682f0 0x7fbff406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:16.887 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:16.870+0000 7fc0164b6700 1 --2- 172.21.15.86:0/1152541741 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7fbff40682f0 0x7fbff406a7a0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fc000000f60 tx=0x7fc000009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T13:49:16.887 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:16.874+0000 7fc006ffd700 1 -- 172.21.15.86:0/1152541741 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fc00c0524d0 con 0x7fc010149420 2023-03-06T13:49:17.098 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.096+0000 7fc01871a700 1 -- 172.21.15.86:0/1152541741 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc01006e610 con 0x7fc010149420 2023-03-06T13:49:17.099 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.097+0000 7fc006ffd700 1 -- 172.21.15.86:0/1152541741 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4642 (secure 0 0 0) 0x7fc00c055af0 con 0x7fc010149420 2023-03-06T13:49:17.099 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-03-06T13:49:17.099 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4262,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.202:6835/1375345216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.202:6833","nonce":1375345216},{"type":"v1","addr":"172.21.15.202:6835","nonce":1375345216}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4275,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6835/3217070924","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":3217070924},{"type":"v1","addr":"172.21.15.86:6835","nonce":3217070924}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4278,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/249061809","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6836","nonce":249061809},{"type":"v1","addr":"172.21.15.86:6837","nonce":249061809}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-03-06T13:49:13.706653+0000","modified":"2023-03-06T13:49:16.718544+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4300},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4300":{"gid":4300,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.202:6834/142821572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.202:6832","nonce":142821572},{"type":"v1","addr":"172.21.15.202:6834","nonce":142821572}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-03-06T13:49:17.101 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.098+0000 7fc01871a700 1 -- 172.21.15.86:0/1152541741 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7fbff40682f0 msgr2=0x7fbff406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:17.101 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.098+0000 7fc01871a700 1 --2- 172.21.15.86:0/1152541741 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7fbff40682f0 0x7fbff406a7a0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fc000000f60 tx=0x7fc000009040 comp rx=0 tx=0).stop 2023-03-06T13:49:17.101 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.098+0000 7fc01871a700 1 -- 172.21.15.86:0/1152541741 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc010149420 msgr2=0x7fc0100a76e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:17.102 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.098+0000 7fc01871a700 1 --2- 172.21.15.86:0/1152541741 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc010149420 0x7fc0100a76e0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fc00c00ec10 tx=0x7fc00c009e20 comp rx=0 tx=0).stop 2023-03-06T13:49:17.102 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.099+0000 7fc01871a700 1 -- 172.21.15.86:0/1152541741 shutdown_connections 2023-03-06T13:49:17.102 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.099+0000 7fc01871a700 1 --2- 172.21.15.86:0/1152541741 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7fbff40682f0 0x7fbff406a7a0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:17.102 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.099+0000 7fc01871a700 1 --2- 172.21.15.86:0/1152541741 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fc01014f600 0x7fc0101e8900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:17.103 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.099+0000 7fc01871a700 1 --2- 172.21.15.86:0/1152541741 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7fc01006ea90 0x7fc0100a53e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:17.103 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.099+0000 7fc01871a700 1 --2- 172.21.15.86:0/1152541741 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc010149420 0x7fc0100a76e0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:17.103 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.099+0000 7fc01871a700 1 -- 172.21.15.86:0/1152541741 >> 172.21.15.86:0/1152541741 conn(0x7fc01006c0d0 msgr2=0x7fc0100beb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T13:49:17.103 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.099+0000 7fc01871a700 1 -- 172.21.15.86:0/1152541741 shutdown_connections 2023-03-06T13:49:17.104 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.099+0000 7fc01871a700 1 -- 172.21.15.86:0/1152541741 wait complete. 2023-03-06T13:49:17.104 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 8 2023-03-06T13:49:17.113 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-03-06T13:49:17.233 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.231+0000 7faca8d8a700 1 Processor -- start 2023-03-06T13:49:17.233 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.231+0000 7faca8d8a700 1 -- start start 2023-03-06T13:49:17.236 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.231+0000 7faca8d8a700 1 --2- >> v2:172.21.15.202:3300/0 conn(0x7faca406ea90 0x7faca414f0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:17.237 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.232+0000 7faca8d8a700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faca4153340 con 0x7faca414f600 2023-03-06T13:49:17.237 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.232+0000 7faca8d8a700 1 -- --> v1:172.21.15.202:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faca41497f0 con 0x7faca4149420 2023-03-06T13:49:17.237 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.232+0000 7faca8d8a700 1 -- --> v2:172.21.15.202:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faca4152750 con 0x7faca406ea90 2023-03-06T13:49:17.237 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.232+0000 7faca2d9d700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7faca414f600 0x7faca4159a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:48782/0 (socket says 172.21.15.86:48782) 2023-03-06T13:49:17.238 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.232+0000 7faca2d9d700 1 -- 172.21.15.86:0/1944406311 learned_addr learned my addr 172.21.15.86:0/1944406311 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-03-06T13:49:17.238 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.232+0000 7faca159a700 1 -- 172.21.15.86:0/1944406311 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3494638948 0 0) 0x7faca4153340 con 0x7faca414f600 2023-03-06T13:49:17.238 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.232+0000 7faca1d9b700 1 --2- 172.21.15.86:0/1944406311 >> v2:172.21.15.202:3300/0 conn(0x7faca406ea90 0x7faca414f0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:17.238 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.232+0000 7faca159a700 1 -- 172.21.15.86:0/1944406311 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fac8c0035b0 con 0x7faca414f600 2023-03-06T13:49:17.239 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.232+0000 7faca159a700 1 -- 172.21.15.86:0/1944406311 <== mon.0 v1:172.21.15.86:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 279610077 0 0) 0x7fac8c0035b0 con 0x7faca414f600 2023-03-06T13:49:17.239 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.232+0000 7faca159a700 1 -- 172.21.15.86:0/1944406311 >> v2:172.21.15.202:3300/0 conn(0x7faca406ea90 msgr2=0x7faca414f0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T13:49:17.239 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.232+0000 7faca159a700 1 --2- 172.21.15.86:0/1944406311 >> v2:172.21.15.202:3300/0 conn(0x7faca406ea90 0x7faca414f0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:17.239 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.232+0000 7faca159a700 1 -- 172.21.15.86:0/1944406311 >> v1:172.21.15.202:6789/0 conn(0x7faca4149420 legacy=0x7faca40c2860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:17.240 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.232+0000 7faca159a700 1 -- 172.21.15.86:0/1944406311 --> v1:172.21.15.86:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faca4152a10 con 0x7faca414f600 2023-03-06T13:49:17.240 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.232+0000 7faca159a700 1 -- 172.21.15.86:0/1944406311 <== mon.0 v1:172.21.15.86:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2191261126 0 0) 0x7fac9c0019f0 con 0x7faca414f600 2023-03-06T13:49:17.240 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.232+0000 7faca159a700 1 -- 172.21.15.86:0/1944406311 >> v1:172.21.15.86:6789/0 conn(0x7faca414f600 legacy=0x7faca4159a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:17.240 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.232+0000 7faca159a700 1 --2- 172.21.15.86:0/1944406311 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fac8c003a70 0x7fac8c003e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:17.240 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.232+0000 7faca159a700 1 --2- 172.21.15.86:0/1944406311 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7fac8c004850 0x7fac8c004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:17.240 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.232+0000 7faca159a700 1 --2- 172.21.15.86:0/1944406311 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fac8c005320 0x7fac8c00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:17.240 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.232+0000 7faca159a700 1 -- 172.21.15.86:0/1944406311 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faca4152750 con 0x7fac8c005320 2023-03-06T13:49:17.241 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.232+0000 7faca159a700 1 -- 172.21.15.86:0/1944406311 --> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac8c00c230 con 0x7fac8c004850 2023-03-06T13:49:17.241 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.232+0000 7faca159a700 1 -- 172.21.15.86:0/1944406311 --> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac8c00c3f0 con 0x7fac8c003a70 2023-03-06T13:49:17.241 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.232+0000 7faca2d9d700 1 --2- 172.21.15.86:0/1944406311 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fac8c005320 0x7fac8c00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:17.241 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.232+0000 7faca1d9b700 1 --2- 172.21.15.86:0/1944406311 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7fac8c004850 0x7fac8c004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:17.241 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.232+0000 7faca259c700 1 --2- 172.21.15.86:0/1944406311 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fac8c003a70 0x7fac8c003e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:17.241 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.233+0000 7faca2d9d700 1 -- 172.21.15.86:0/1944406311 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fac8c003a70 msgr2=0x7fac8c003e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T13:49:17.241 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.233+0000 7faca2d9d700 1 --2- 172.21.15.86:0/1944406311 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fac8c003a70 0x7fac8c003e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:17.242 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.233+0000 7faca2d9d700 1 -- 172.21.15.86:0/1944406311 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7fac8c004850 msgr2=0x7fac8c004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T13:49:17.242 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.233+0000 7faca2d9d700 1 --2- 172.21.15.86:0/1944406311 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7fac8c004850 0x7fac8c004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:17.242 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.233+0000 7faca2d9d700 1 -- 172.21.15.86:0/1944406311 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac8c0035b0 con 0x7fac8c005320 2023-03-06T13:49:17.242 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.233+0000 7faca259c700 1 --2- 172.21.15.86:0/1944406311 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fac8c003a70 0x7fac8c003e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-06T13:49:17.242 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.233+0000 7faca2d9d700 1 -- 172.21.15.86:0/1944406311 reap_dead start 2023-03-06T13:49:17.242 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.233+0000 7faca2d9d700 1 --2- 172.21.15.86:0/1944406311 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fac8c005320 0x7fac8c00ba10 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fac9c00a830 tx=0x7fac8c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=898a57d50cf1bb32 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T13:49:17.242 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.233+0000 7faca159a700 1 -- 172.21.15.86:0/1944406311 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac9c00a2f0 con 0x7fac8c005320 2023-03-06T13:49:17.242 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.233+0000 7faca159a700 1 -- 172.21.15.86:0/1944406311 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac9c012620 con 0x7fac8c005320 2023-03-06T13:49:17.243 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.233+0000 7faca159a700 1 -- 172.21.15.86:0/1944406311 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac9c0129d0 con 0x7fac8c005320 2023-03-06T13:49:17.243 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.233+0000 7faca8d8a700 1 -- 172.21.15.86:0/1944406311 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fac8c005320 msgr2=0x7fac8c00ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:17.243 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.233+0000 7faca8d8a700 1 --2- 172.21.15.86:0/1944406311 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fac8c005320 0x7fac8c00ba10 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fac9c00a830 tx=0x7fac8c005880 comp rx=0 tx=0).stop 2023-03-06T13:49:17.243 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.233+0000 7faca8d8a700 1 -- 172.21.15.86:0/1944406311 shutdown_connections 2023-03-06T13:49:17.244 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.233+0000 7faca8d8a700 1 --2- 172.21.15.86:0/1944406311 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fac8c005320 0x7fac8c00ba10 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:17.244 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.233+0000 7faca8d8a700 1 -- 172.21.15.86:0/1944406311 >> 172.21.15.86:0/1944406311 conn(0x7faca406c0d0 msgr2=0x7faca40c2150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T13:49:17.244 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.233+0000 7faca8d8a700 1 -- 172.21.15.86:0/1944406311 shutdown_connections 2023-03-06T13:49:17.244 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.234+0000 7faca8d8a700 1 -- 172.21.15.86:0/1944406311 wait complete. 2023-03-06T13:49:17.244 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.235+0000 7faca8d8a700 1 Processor -- start 2023-03-06T13:49:17.244 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.235+0000 7faca8d8a700 1 -- start start 2023-03-06T13:49:17.246 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.235+0000 7faca8d8a700 1 --2- >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7fac8c005320 0x7faca41dadc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:17.246 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.235+0000 7faca8d8a700 1 --2- >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7faca414d9d0 0x7faca41d9a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:17.247 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.235+0000 7faca8d8a700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faca414de40 0x7faca41d9f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:17.247 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.235+0000 7faca8d8a700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faca41db300 con 0x7faca414de40 2023-03-06T13:49:17.247 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.235+0000 7faca8d8a700 1 -- --> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faca41db930 con 0x7fac8c005320 2023-03-06T13:49:17.247 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.235+0000 7faca8d8a700 1 -- --> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faca41dbc10 con 0x7faca414d9d0 2023-03-06T13:49:17.247 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.235+0000 7faca2d9d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faca414de40 0x7faca41d9f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:17.247 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.235+0000 7faca2d9d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faca414de40 0x7faca41d9f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:38646/0 (socket says 172.21.15.86:38646) 2023-03-06T13:49:17.247 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.236+0000 7faca2d9d700 1 -- 172.21.15.86:0/1218866724 learned_addr learned my addr 172.21.15.86:0/1218866724 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-03-06T13:49:17.248 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.236+0000 7faca1d9b700 1 --2- 172.21.15.86:0/1218866724 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7faca414d9d0 0x7faca41d9a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:17.248 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.236+0000 7faca259c700 1 --2- 172.21.15.86:0/1218866724 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7fac8c005320 0x7faca41dadc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:17.248 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.236+0000 7faca2d9d700 1 -- 172.21.15.86:0/1218866724 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7faca414d9d0 msgr2=0x7faca41d9a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:17.248 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.236+0000 7faca2d9d700 1 --2- 172.21.15.86:0/1218866724 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7faca414d9d0 0x7faca41d9a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:17.248 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.236+0000 7faca2d9d700 1 -- 172.21.15.86:0/1218866724 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7fac8c005320 msgr2=0x7faca41dadc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:17.248 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.236+0000 7faca2d9d700 1 --2- 172.21.15.86:0/1218866724 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7fac8c005320 0x7faca41dadc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:17.249 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.236+0000 7faca2d9d700 1 -- 172.21.15.86:0/1218866724 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faca4152fd0 con 0x7faca414de40 2023-03-06T13:49:17.249 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.236+0000 7faca2d9d700 1 --2- 172.21.15.86:0/1218866724 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faca414de40 0x7faca41d9f90 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7faca40a50c0 tx=0x7fac9c001d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T13:49:17.249 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.236+0000 7fac92ffd700 1 -- 172.21.15.86:0/1218866724 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac9c0012d0 con 0x7faca414de40 2023-03-06T13:49:17.249 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.236+0000 7fac92ffd700 1 -- 172.21.15.86:0/1218866724 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac9c001430 con 0x7faca414de40 2023-03-06T13:49:17.249 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.236+0000 7faca8d8a700 1 -- 172.21.15.86:0/1218866724 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faca4152cf0 con 0x7faca414de40 2023-03-06T13:49:17.249 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.236+0000 7fac92ffd700 1 -- 172.21.15.86:0/1218866724 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac9c01e430 con 0x7faca414de40 2023-03-06T13:49:17.249 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.236+0000 7faca8d8a700 1 -- 172.21.15.86:0/1218866724 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faca406e610 con 0x7faca414de40 2023-03-06T13:49:17.250 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.237+0000 7faca8d8a700 1 -- 172.21.15.86:0/1218866724 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faca404e750 con 0x7faca414de40 2023-03-06T13:49:17.250 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.237+0000 7fac92ffd700 1 -- 172.21.15.86:0/1218866724 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fac9c010070 con 0x7faca414de40 2023-03-06T13:49:17.250 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.238+0000 7fac92ffd700 1 --2- 172.21.15.86:0/1218866724 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7fac84068320 0x7fac8406a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:17.250 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.238+0000 7fac92ffd700 1 -- 172.21.15.86:0/1218866724 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fac9c087b70 con 0x7faca414de40 2023-03-06T13:49:17.250 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.238+0000 7faca259c700 1 --2- 172.21.15.86:0/1218866724 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7fac84068320 0x7fac8406a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:17.250 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.238+0000 7faca259c700 1 --2- 172.21.15.86:0/1218866724 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7fac84068320 0x7fac8406a7d0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fac940016d0 tx=0x7fac94009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T13:49:17.250 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.242+0000 7fac92ffd700 1 -- 172.21.15.86:0/1218866724 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fac9c054350 con 0x7faca414de40 2023-03-06T13:49:17.429 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.426+0000 7faca8d8a700 1 -- 172.21.15.86:0/1218866724 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7faca41d9770 con 0x7faca414de40 2023-03-06T13:49:17.430 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.427+0000 7fac92ffd700 1 -- 172.21.15.86:0/1218866724 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+17811 (secure 0 0 0) 0x7faca41d9770 con 0x7faca414de40 2023-03-06T13:49:17.430 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-03-06T13:49:17.430 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":23,"fsid":"2cca6c77-50cb-47d8-a8c7-444575d01327","created":"2023-03-06T13:48:48.337369+0000","modified":"2023-03-06T13:49:14.708570+0000","last_up_change":"2023-03-06T13:48:59.782729+0000","last_in_change":"2023-03-06T13:48:50.777249+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-03-06T13:48:59.879087+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-03-06T13:49:06.686394+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-03-06T13:49:11.362997+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-03-06T13:49:12.753969+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2de68e69-e10f-49e1-a15a-8a9bfff504c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":96739},{"type":"v1","addr":"172.21.15.86:6816","nonce":96739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":96739},{"type":"v1","addr":"172.21.15.86:6819","nonce":96739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":96739},{"type":"v1","addr":"172.21.15.86:6823","nonce":96739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":96739},{"type":"v1","addr":"172.21.15.86:6821","nonce":96739}]},"public_addr":"172.21.15.86:6816/96739","cluster_addr":"172.21.15.86:6819/96739","heartbeat_back_addr":"172.21.15.86:6823/96739","heartbeat_front_addr":"172.21.15.86:6821/96739","state":["exists","up"]},{"osd":1,"uuid":"3e75c061-0de5-4742-a20d-4b5a4adb9b81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":96738},{"type":"v1","addr":"172.21.15.86:6801","nonce":96738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":96738},{"type":"v1","addr":"172.21.15.86:6803","nonce":96738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":96738},{"type":"v1","addr":"172.21.15.86:6807","nonce":96738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":96738},{"type":"v1","addr":"172.21.15.86:6805","nonce":96738}]},"public_addr":"172.21.15.86:6801/96738","cluster_addr":"172.21.15.86:6803/96738","heartbeat_back_addr":"172.21.15.86:6807/96738","heartbeat_front_addr":"172.21.15.86:6805/96738","state":["exists","up"]},{"osd":2,"uuid":"38d71bce-81c2-4e33-91e1-65efb08f2291","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":96740},{"type":"v1","addr":"172.21.15.86:6809","nonce":96740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":96740},{"type":"v1","addr":"172.21.15.86:6811","nonce":96740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6815","nonce":96740},{"type":"v1","addr":"172.21.15.86:6817","nonce":96740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":96740},{"type":"v1","addr":"172.21.15.86:6813","nonce":96740}]},"public_addr":"172.21.15.86:6809/96740","cluster_addr":"172.21.15.86:6811/96740","heartbeat_back_addr":"172.21.15.86:6817/96740","heartbeat_front_addr":"172.21.15.86:6813/96740","state":["exists","up"]},{"osd":3,"uuid":"d95a2686-21bd-4b66-9ea5-eef65403935b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":96756},{"type":"v1","addr":"172.21.15.86:6825","nonce":96756}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":96756},{"type":"v1","addr":"172.21.15.86:6827","nonce":96756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":96756},{"type":"v1","addr":"172.21.15.86:6831","nonce":96756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":96756},{"type":"v1","addr":"172.21.15.86:6829","nonce":96756}]},"public_addr":"172.21.15.86:6825/96756","cluster_addr":"172.21.15.86:6827/96756","heartbeat_back_addr":"172.21.15.86:6831/96756","heartbeat_front_addr":"172.21.15.86:6829/96756","state":["exists","up"]},{"osd":4,"uuid":"98c7e359-0f00-496a-8aaa-5472af355e48","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.202:6816","nonce":96847},{"type":"v1","addr":"172.21.15.202:6817","nonce":96847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.202:6818","nonce":96847},{"type":"v1","addr":"172.21.15.202:6819","nonce":96847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.202:6822","nonce":96847},{"type":"v1","addr":"172.21.15.202:6823","nonce":96847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.202:6820","nonce":96847},{"type":"v1","addr":"172.21.15.202:6821","nonce":96847}]},"public_addr":"172.21.15.202:6817/96847","cluster_addr":"172.21.15.202:6819/96847","heartbeat_back_addr":"172.21.15.202:6823/96847","heartbeat_front_addr":"172.21.15.202:6821/96847","state":["exists","up"]},{"osd":5,"uuid":"fa6688d9-73f3-4593-a50e-d96a0fe5f4cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.202:6824","nonce":96848},{"type":"v1","addr":"172.21.15.202:6825","nonce":96848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.202:6826","nonce":96848},{"type":"v1","addr":"172.21.15.202:6827","nonce":96848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.202:6830","nonce":96848},{"type":"v1","addr":"172.21.15.202:6831","nonce":96848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.202:6828","nonce":96848},{"type":"v1","addr":"172.21.15.202:6829","nonce":96848}]},"public_addr":"172.21.15.202:6825/96848","cluster_addr":"172.21.15.202:6827/96848","heartbeat_back_addr":"172.21.15.202:6831/96848","heartbeat_front_addr":"172.21.15.202:6829/96848","state":["exists","up"]},{"osd":6,"uuid":"7bfc6dc0-2388-4498-9cd7-766e3606f6a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.202:6808","nonce":96845},{"type":"v1","addr":"172.21.15.202:6809","nonce":96845}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.202:6810","nonce":96845},{"type":"v1","addr":"172.21.15.202:6811","nonce":96845}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.202:6814","nonce":96845},{"type":"v1","addr":"172.21.15.202:6815","nonce":96845}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.202:6812","nonce":96845},{"type":"v1","addr":"172.21.15.202:6813","nonce":96845}]},"public_addr":"172.21.15.202:6809/96845","cluster_addr":"172.21.15.202:6811/96845","heartbeat_back_addr":"172.21.15.202:6815/96845","heartbeat_front_addr":"172.21.15.202:6813/96845","state":["exists","up"]},{"osd":7,"uuid":"c475f863-96fd-48e3-8033-7d1c3b1d503f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.202:6800","nonce":96846},{"type":"v1","addr":"172.21.15.202:6801","nonce":96846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.202:6802","nonce":96846},{"type":"v1","addr":"172.21.15.202:6803","nonce":96846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.202:6806","nonce":96846},{"type":"v1","addr":"172.21.15.202:6807","nonce":96846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.202:6804","nonce":96846},{"type":"v1","addr":"172.21.15.202:6805","nonce":96846}]},"public_addr":"172.21.15.202:6801/96846","cluster_addr":"172.21.15.202:6803/96846","heartbeat_back_addr":"172.21.15.202:6807/96846","heartbeat_front_addr":"172.21.15.202:6805/96846","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-06T13:48:55.997991+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-06T13:48:55.930805+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-06T13:48:56.000312+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-06T13:48:55.998360+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-06T13:48:56.052762+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-06T13:48:56.036049+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-06T13:48:56.048751+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-06T13:48:56.011928+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-03-06T13:49:17.432 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.430+0000 7faca8d8a700 1 -- 172.21.15.86:0/1218866724 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7fac84068320 msgr2=0x7fac8406a7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:17.432 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.430+0000 7faca8d8a700 1 --2- 172.21.15.86:0/1218866724 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7fac84068320 0x7fac8406a7d0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fac940016d0 tx=0x7fac94009040 comp rx=0 tx=0).stop 2023-03-06T13:49:17.432 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.430+0000 7faca8d8a700 1 -- 172.21.15.86:0/1218866724 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faca414de40 msgr2=0x7faca41d9f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:17.432 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.430+0000 7faca8d8a700 1 --2- 172.21.15.86:0/1218866724 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faca414de40 0x7faca41d9f90 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7faca40a50c0 tx=0x7fac9c001d80 comp rx=0 tx=0).stop 2023-03-06T13:49:17.433 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.430+0000 7faca8d8a700 1 -- 172.21.15.86:0/1218866724 shutdown_connections 2023-03-06T13:49:17.433 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.430+0000 7faca8d8a700 1 --2- 172.21.15.86:0/1218866724 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7fac84068320 0x7fac8406a7d0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:17.433 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.430+0000 7faca8d8a700 1 --2- 172.21.15.86:0/1218866724 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faca414de40 0x7faca41d9f90 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:17.433 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.430+0000 7faca8d8a700 1 --2- 172.21.15.86:0/1218866724 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7fac8c005320 0x7faca41dadc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:17.433 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.430+0000 7faca8d8a700 1 --2- 172.21.15.86:0/1218866724 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7faca414d9d0 0x7faca41d9a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:17.433 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.430+0000 7faca8d8a700 1 -- 172.21.15.86:0/1218866724 >> 172.21.15.86:0/1218866724 conn(0x7faca406c0d0 msgr2=0x7faca406a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T13:49:17.434 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.430+0000 7faca8d8a700 1 -- 172.21.15.86:0/1218866724 shutdown_connections 2023-03-06T13:49:17.434 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.430+0000 7faca8d8a700 1 -- 172.21.15.86:0/1218866724 wait complete. 2023-03-06T13:49:17.444 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-03-06T13:49:17.444 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-03-06T13:49:17.564 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.562+0000 7f9c3d3a9700 1 Processor -- start 2023-03-06T13:49:17.565 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.563+0000 7f9c3d3a9700 1 -- start start 2023-03-06T13:49:17.566 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.563+0000 7f9c3d3a9700 1 --2- >> v2:172.21.15.202:3300/0 conn(0x7f9c3806bcf0 0x7f9c3806c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:17.567 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.563+0000 7f9c3d3a9700 1 --2- >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f9c3806a330 0x7f9c380c32a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:17.567 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.563+0000 7f9c3d3a9700 1 -- --> v1:172.21.15.202:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c3814fb40 con 0x7f9c380c37e0 2023-03-06T13:49:17.567 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.563+0000 7f9c3d3a9700 1 -- --> v2:172.21.15.202:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c380c0060 con 0x7f9c3806bcf0 2023-03-06T13:49:17.567 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.563+0000 7f9c3d3a9700 1 -- --> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c380b8d00 con 0x7f9c3806a330 2023-03-06T13:49:17.567 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.563+0000 7f9c367fc700 1 --2- >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f9c3806a330 0x7f9c380c32a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:17.568 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.563+0000 7f9c367fc700 1 --2- >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f9c3806a330 0x7f9c380c32a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.202:3301/0 says I am v2:172.21.15.86:50344/0 (socket says 172.21.15.86:50344) 2023-03-06T13:49:17.568 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.563+0000 7f9c367fc700 1 -- 172.21.15.86:0/2231688926 learned_addr learned my addr 172.21.15.86:0/2231688926 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-03-06T13:49:17.568 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.563+0000 7f9c36ffd700 1 --2- 172.21.15.86:0/2231688926 >> v2:172.21.15.202:3300/0 conn(0x7f9c3806bcf0 0x7f9c3806c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:17.568 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.564+0000 7f9c35ffb700 1 -- 172.21.15.86:0/2231688926 <== mon.1 v1:172.21.15.202:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4107540532 0 0) 0x7f9c3814fb40 con 0x7f9c380c37e0 2023-03-06T13:49:17.568 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.564+0000 7f9c367fc700 1 -- 172.21.15.86:0/2231688926 >> v2:172.21.15.202:3300/0 conn(0x7f9c3806bcf0 msgr2=0x7f9c3806c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T13:49:17.569 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.564+0000 7f9c367fc700 1 --2- 172.21.15.86:0/2231688926 >> v2:172.21.15.202:3300/0 conn(0x7f9c3806bcf0 0x7f9c3806c0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:17.569 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.564+0000 7f9c367fc700 1 -- 172.21.15.86:0/2231688926 >> v1:172.21.15.202:6789/0 conn(0x7f9c380c37e0 legacy=0x7f9c381526b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:17.569 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.564+0000 7f9c367fc700 1 -- 172.21.15.86:0/2231688926 --> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c380c3c20 con 0x7f9c3806a330 2023-03-06T13:49:17.569 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.564+0000 7f9c367fc700 1 --2- 172.21.15.86:0/2231688926 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f9c3806a330 0x7f9c380c32a0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f9c280098f0 tx=0x7f9c28009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cc220842ec140e3f server_cookie=0 in_seq=0 out_seq=0 2023-03-06T13:49:17.569 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.564+0000 7f9c35ffb700 1 -- 172.21.15.86:0/2231688926 <== mon.2 v2:172.21.15.202:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c28011830 con 0x7f9c3806a330 2023-03-06T13:49:17.569 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.564+0000 7f9c35ffb700 1 -- 172.21.15.86:0/2231688926 <== mon.2 v2:172.21.15.202:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c28011990 con 0x7f9c3806a330 2023-03-06T13:49:17.569 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.564+0000 7f9c35ffb700 1 -- 172.21.15.86:0/2231688926 <== mon.2 v2:172.21.15.202:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c28011d20 con 0x7f9c3806a330 2023-03-06T13:49:17.570 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.565+0000 7f9c3d3a9700 1 -- 172.21.15.86:0/2231688926 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f9c3806a330 msgr2=0x7f9c380c32a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:17.570 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.565+0000 7f9c3d3a9700 1 --2- 172.21.15.86:0/2231688926 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f9c3806a330 0x7f9c380c32a0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f9c280098f0 tx=0x7f9c28009c00 comp rx=0 tx=0).stop 2023-03-06T13:49:17.570 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.565+0000 7f9c3d3a9700 1 -- 172.21.15.86:0/2231688926 shutdown_connections 2023-03-06T13:49:17.570 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.565+0000 7f9c3d3a9700 1 --2- 172.21.15.86:0/2231688926 >> v2:172.21.15.202:3300/0 conn(0x7f9c3806bcf0 0x7f9c3806c0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:17.570 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.565+0000 7f9c3d3a9700 1 --2- 172.21.15.86:0/2231688926 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f9c3806a330 0x7f9c380c32a0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:17.570 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.565+0000 7f9c3d3a9700 1 -- 172.21.15.86:0/2231688926 >> 172.21.15.86:0/2231688926 conn(0x7f9c380a6f40 msgr2=0x7f9c380a7340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T13:49:17.570 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.565+0000 7f9c3d3a9700 1 -- 172.21.15.86:0/2231688926 shutdown_connections 2023-03-06T13:49:17.571 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.565+0000 7f9c3d3a9700 1 -- 172.21.15.86:0/2231688926 wait complete. 2023-03-06T13:49:17.573 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.566+0000 7f9c3d3a9700 1 Processor -- start 2023-03-06T13:49:17.573 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.566+0000 7f9c3d3a9700 1 -- start start 2023-03-06T13:49:17.574 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.567+0000 7f9c3d3a9700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9c3806a330 0x7f9c380a5c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:17.574 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.567+0000 7f9c3d3a9700 1 --2- >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f9c3806bcf0 0x7f9c380a9410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:17.574 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.567+0000 7f9c3d3a9700 1 --2- >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f9c380c37e0 0x7f9c380aa230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:17.574 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.567+0000 7f9c3d3a9700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c380a8380 con 0x7f9c3806a330 2023-03-06T13:49:17.574 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.567+0000 7f9c3d3a9700 1 -- --> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c380a6140 con 0x7f9c380c37e0 2023-03-06T13:49:17.574 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.567+0000 7f9c3d3a9700 1 -- --> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c381e5950 con 0x7f9c3806bcf0 2023-03-06T13:49:17.575 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.567+0000 7f9c36ffd700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9c3806a330 0x7f9c380a5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:17.575 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.567+0000 7f9c36ffd700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9c3806a330 0x7f9c380a5c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:38656/0 (socket says 172.21.15.86:38656) 2023-03-06T13:49:17.575 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.567+0000 7f9c36ffd700 1 -- 172.21.15.86:0/3511646515 learned_addr learned my addr 172.21.15.86:0/3511646515 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-03-06T13:49:17.575 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.567+0000 7f9c367fc700 1 --2- 172.21.15.86:0/3511646515 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f9c3806bcf0 0x7f9c380a9410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:17.575 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.567+0000 7f9c377fe700 1 --2- 172.21.15.86:0/3511646515 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f9c380c37e0 0x7f9c380aa230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:17.575 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.567+0000 7f9c36ffd700 1 -- 172.21.15.86:0/3511646515 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f9c3806bcf0 msgr2=0x7f9c380a9410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:17.575 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.567+0000 7f9c36ffd700 1 --2- 172.21.15.86:0/3511646515 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f9c3806bcf0 0x7f9c380a9410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:17.575 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.567+0000 7f9c36ffd700 1 -- 172.21.15.86:0/3511646515 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f9c380c37e0 msgr2=0x7f9c380aa230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:17.576 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.567+0000 7f9c36ffd700 1 --2- 172.21.15.86:0/3511646515 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f9c380c37e0 0x7f9c380aa230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:17.576 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.567+0000 7f9c36ffd700 1 -- 172.21.15.86:0/3511646515 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c28009550 con 0x7f9c3806a330 2023-03-06T13:49:17.576 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.567+0000 7f9c377fe700 1 --2- 172.21.15.86:0/3511646515 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f9c380c37e0 0x7f9c380aa230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-06T13:49:17.576 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.567+0000 7f9c36ffd700 1 --2- 172.21.15.86:0/3511646515 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9c3806a330 0x7f9c380a5c00 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f9c2c00e8a0 tx=0x7f9c2c00ebb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T13:49:17.576 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.567+0000 7f9c1f7fe700 1 -- 172.21.15.86:0/3511646515 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c2c009590 con 0x7f9c3806a330 2023-03-06T13:49:17.576 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.567+0000 7f9c1f7fe700 1 -- 172.21.15.86:0/3511646515 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c2c013680 con 0x7f9c3806a330 2023-03-06T13:49:17.577 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.567+0000 7f9c3d3a9700 1 -- 172.21.15.86:0/3511646515 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c3814fd90 con 0x7f9c3806a330 2023-03-06T13:49:17.577 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.567+0000 7f9c1f7fe700 1 -- 172.21.15.86:0/3511646515 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c2c0139f0 con 0x7f9c3806a330 2023-03-06T13:49:17.577 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.567+0000 7f9c3d3a9700 1 -- 172.21.15.86:0/3511646515 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c380c0300 con 0x7f9c3806a330 2023-03-06T13:49:17.577 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.568+0000 7f9c3d3a9700 1 -- 172.21.15.86:0/3511646515 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c380c51b0 con 0x7f9c3806a330 2023-03-06T13:49:17.577 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.569+0000 7f9c1f7fe700 1 -- 172.21.15.86:0/3511646515 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f9c2c019030 con 0x7f9c3806a330 2023-03-06T13:49:17.577 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.569+0000 7f9c1f7fe700 1 --2- 172.21.15.86:0/3511646515 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7f9c240682f0 0x7f9c2406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:17.577 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.569+0000 7f9c1f7fe700 1 -- 172.21.15.86:0/3511646515 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9c2c085a30 con 0x7f9c3806a330 2023-03-06T13:49:17.578 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.569+0000 7f9c367fc700 1 --2- 172.21.15.86:0/3511646515 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7f9c240682f0 0x7f9c2406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:17.578 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.569+0000 7f9c367fc700 1 --2- 172.21.15.86:0/3511646515 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7f9c240682f0 0x7f9c2406a7a0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f9c28014040 tx=0x7f9c28008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T13:49:17.578 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.573+0000 7f9c1f7fe700 1 -- 172.21.15.86:0/3511646515 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f9c2c052290 con 0x7f9c3806a330 2023-03-06T13:49:17.755 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.753+0000 7f9c3d3a9700 1 -- 172.21.15.86:0/3511646515 --> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9c3804e750 con 0x7f9c240682f0 2023-03-06T13:49:17.763 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.761+0000 7f9c1f7fe700 1 -- 172.21.15.86:0/3511646515 <== mgr.4101 v2:172.21.15.86:6832/96468 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286638 (secure 0 0 0) 0x7f9c3804e750 con 0x7f9c240682f0 2023-03-06T13:49:17.766 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-03-06T13:49:17.768 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.764+0000 7f9c3d3a9700 1 -- 172.21.15.86:0/3511646515 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7f9c240682f0 msgr2=0x7f9c2406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:17.768 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.764+0000 7f9c3d3a9700 1 --2- 172.21.15.86:0/3511646515 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7f9c240682f0 0x7f9c2406a7a0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f9c28014040 tx=0x7f9c28008030 comp rx=0 tx=0).stop 2023-03-06T13:49:17.769 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.764+0000 7f9c3d3a9700 1 -- 172.21.15.86:0/3511646515 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9c3806a330 msgr2=0x7f9c380a5c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:17.769 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.764+0000 7f9c3d3a9700 1 --2- 172.21.15.86:0/3511646515 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9c3806a330 0x7f9c380a5c00 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f9c2c00e8a0 tx=0x7f9c2c00ebb0 comp rx=0 tx=0).stop 2023-03-06T13:49:17.769 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.764+0000 7f9c3d3a9700 1 -- 172.21.15.86:0/3511646515 shutdown_connections 2023-03-06T13:49:17.769 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.764+0000 7f9c3d3a9700 1 --2- 172.21.15.86:0/3511646515 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7f9c240682f0 0x7f9c2406a7a0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:17.769 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.764+0000 7f9c3d3a9700 1 --2- 172.21.15.86:0/3511646515 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9c3806a330 0x7f9c380a5c00 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:17.769 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.764+0000 7f9c3d3a9700 1 --2- 172.21.15.86:0/3511646515 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f9c380c37e0 0x7f9c380aa230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:17.769 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.764+0000 7f9c3d3a9700 1 --2- 172.21.15.86:0/3511646515 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f9c3806bcf0 0x7f9c380a9410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:17.770 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.765+0000 7f9c3d3a9700 1 -- 172.21.15.86:0/3511646515 >> 172.21.15.86:0/3511646515 conn(0x7f9c380a6f40 msgr2=0x7f9c380c0c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T13:49:17.770 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.765+0000 7f9c3d3a9700 1 -- 172.21.15.86:0/3511646515 shutdown_connections 2023-03-06T13:49:17.770 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.765+0000 7f9c3d3a9700 1 -- 172.21.15.86:0/3511646515 wait complete. 2023-03-06T13:49:17.770 INFO:teuthology.orchestra.run.smithi086.stderr:dumped all 2023-03-06T13:49:17.778 INFO:teuthology.orchestra.run.smithi086.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2023-03-06T13:49:15.836698+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592698,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":114,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":66120,"kb_used_data":3016,"kb_used_omap":0,"kb_used_meta":63040,"kb_avail":754908600,"statfs":{"total":773094113280,"available":773026406400,"internally_reserved":0,"allocated":3088384,"data_stored":1848964,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":64552960},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2330,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000825"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:13.730957+0000","last_change":"2023-03-06T13:49:13.726873+0000","last_active":"2023-03-06T13:49:13.730957+0000","last_peered":"2023-03-06T13:49:13.730957+0000","last_clean":"2023-03-06T13:49:13.730957+0000","last_became_active":"2023-03-06T13:49:13.726628+0000","last_became_peered":"2023-03-06T13:49:13.726628+0000","last_unstale":"2023-03-06T13:49:13.730957+0000","last_undegraded":"2023-03-06T13:49:13.730957+0000","last_fullsized":"2023-03-06T13:49:13.730957+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T19:17:36.354708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:13.728236+0000","last_change":"2023-03-06T13:49:13.721134+0000","last_active":"2023-03-06T13:49:13.728236+0000","last_peered":"2023-03-06T13:49:13.728236+0000","last_clean":"2023-03-06T13:49:13.728236+0000","last_became_active":"2023-03-06T13:49:13.720869+0000","last_became_peered":"2023-03-06T13:49:13.720869+0000","last_unstale":"2023-03-06T13:49:13.728236+0000","last_undegraded":"2023-03-06T13:49:13.728236+0000","last_fullsized":"2023-03-06T13:49:13.728236+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T16:46:29.744316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:13.734262+0000","last_change":"2023-03-06T13:49:13.729489+0000","last_active":"2023-03-06T13:49:13.734262+0000","last_peered":"2023-03-06T13:49:13.734262+0000","last_clean":"2023-03-06T13:49:13.734262+0000","last_became_active":"2023-03-06T13:49:13.729243+0000","last_became_peered":"2023-03-06T13:49:13.729243+0000","last_unstale":"2023-03-06T13:49:13.734262+0000","last_undegraded":"2023-03-06T13:49:13.734262+0000","last_fullsized":"2023-03-06T13:49:13.734262+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T19:08:52.672756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-06T13:49:14.715661+0000","last_change":"2023-03-06T13:49:13.726808+0000","last_active":"2023-03-06T13:49:14.715661+0000","last_peered":"2023-03-06T13:49:14.715661+0000","last_clean":"2023-03-06T13:49:14.715661+0000","last_became_active":"2023-03-06T13:49:13.726503+0000","last_became_peered":"2023-03-06T13:49:13.726503+0000","last_unstale":"2023-03-06T13:49:14.715661+0000","last_undegraded":"2023-03-06T13:49:14.715661+0000","last_fullsized":"2023-03-06T13:49:14.715661+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T18:44:55.549229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:13.729675+0000","last_change":"2023-03-06T13:49:13.725773+0000","last_active":"2023-03-06T13:49:13.729675+0000","last_peered":"2023-03-06T13:49:13.729675+0000","last_clean":"2023-03-06T13:49:13.729675+0000","last_became_active":"2023-03-06T13:49:13.725564+0000","last_became_peered":"2023-03-06T13:49:13.725564+0000","last_unstale":"2023-03-06T13:49:13.729675+0000","last_undegraded":"2023-03-06T13:49:13.729675+0000","last_fullsized":"2023-03-06T13:49:13.729675+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T20:18:58.498628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:13.734908+0000","last_change":"2023-03-06T13:49:13.729753+0000","last_active":"2023-03-06T13:49:13.734908+0000","last_peered":"2023-03-06T13:49:13.734908+0000","last_clean":"2023-03-06T13:49:13.734908+0000","last_became_active":"2023-03-06T13:49:13.729417+0000","last_became_peered":"2023-03-06T13:49:13.729417+0000","last_unstale":"2023-03-06T13:49:13.734908+0000","last_undegraded":"2023-03-06T13:49:13.734908+0000","last_fullsized":"2023-03-06T13:49:13.734908+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T18:31:22.344849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:13.734937+0000","last_change":"2023-03-06T13:49:13.732669+0000","last_active":"2023-03-06T13:49:13.734937+0000","last_peered":"2023-03-06T13:49:13.734937+0000","last_clean":"2023-03-06T13:49:13.734937+0000","last_became_active":"2023-03-06T13:49:13.732195+0000","last_became_peered":"2023-03-06T13:49:13.732195+0000","last_unstale":"2023-03-06T13:49:13.734937+0000","last_undegraded":"2023-03-06T13:49:13.734937+0000","last_fullsized":"2023-03-06T13:49:13.734937+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T19:41:30.016073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:13.733212+0000","last_change":"2023-03-06T13:49:13.731729+0000","last_active":"2023-03-06T13:49:13.733212+0000","last_peered":"2023-03-06T13:49:13.733212+0000","last_clean":"2023-03-06T13:49:13.733212+0000","last_became_active":"2023-03-06T13:49:13.731424+0000","last_became_peered":"2023-03-06T13:49:13.731424+0000","last_unstale":"2023-03-06T13:49:13.733212+0000","last_undegraded":"2023-03-06T13:49:13.733212+0000","last_fullsized":"2023-03-06T13:49:13.733212+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T19:41:30.016073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:13.734989+0000","last_change":"2023-03-06T13:49:13.731091+0000","last_active":"2023-03-06T13:49:13.734989+0000","last_peered":"2023-03-06T13:49:13.734989+0000","last_clean":"2023-03-06T13:49:13.734989+0000","last_became_active":"2023-03-06T13:49:13.730858+0000","last_became_peered":"2023-03-06T13:49:13.730858+0000","last_unstale":"2023-03-06T13:49:13.734989+0000","last_undegraded":"2023-03-06T13:49:13.734989+0000","last_fullsized":"2023-03-06T13:49:13.734989+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T17:11:13.619652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:13.731061+0000","last_change":"2023-03-06T13:49:13.726985+0000","last_active":"2023-03-06T13:49:13.731061+0000","last_peered":"2023-03-06T13:49:13.731061+0000","last_clean":"2023-03-06T13:49:13.731061+0000","last_became_active":"2023-03-06T13:49:13.726697+0000","last_became_peered":"2023-03-06T13:49:13.726697+0000","last_unstale":"2023-03-06T13:49:13.731061+0000","last_undegraded":"2023-03-06T13:49:13.731061+0000","last_fullsized":"2023-03-06T13:49:13.731061+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T22:37:42.599167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:13.736884+0000","last_change":"2023-03-06T13:49:13.735341+0000","last_active":"2023-03-06T13:49:13.736884+0000","last_peered":"2023-03-06T13:49:13.736884+0000","last_clean":"2023-03-06T13:49:13.736884+0000","last_became_active":"2023-03-06T13:49:13.733728+0000","last_became_peered":"2023-03-06T13:49:13.733728+0000","last_unstale":"2023-03-06T13:49:13.736884+0000","last_undegraded":"2023-03-06T13:49:13.736884+0000","last_fullsized":"2023-03-06T13:49:13.736884+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T14:31:12.427709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:13.736688+0000","last_change":"2023-03-06T13:49:13.733654+0000","last_active":"2023-03-06T13:49:13.736688+0000","last_peered":"2023-03-06T13:49:13.736688+0000","last_clean":"2023-03-06T13:49:13.736688+0000","last_became_active":"2023-03-06T13:49:13.733408+0000","last_became_peered":"2023-03-06T13:49:13.733408+0000","last_unstale":"2023-03-06T13:49:13.736688+0000","last_undegraded":"2023-03-06T13:49:13.736688+0000","last_fullsized":"2023-03-06T13:49:13.736688+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T20:23:18.245157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:13.730816+0000","last_change":"2023-03-06T13:49:13.726066+0000","last_active":"2023-03-06T13:49:13.730816+0000","last_peered":"2023-03-06T13:49:13.730816+0000","last_clean":"2023-03-06T13:49:13.730816+0000","last_became_active":"2023-03-06T13:49:13.725767+0000","last_became_peered":"2023-03-06T13:49:13.725767+0000","last_unstale":"2023-03-06T13:49:13.730816+0000","last_undegraded":"2023-03-06T13:49:13.730816+0000","last_fullsized":"2023-03-06T13:49:13.730816+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T16:21:45.003183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:13.728022+0000","last_change":"2023-03-06T13:49:13.721687+0000","last_active":"2023-03-06T13:49:13.728022+0000","last_peered":"2023-03-06T13:49:13.728022+0000","last_clean":"2023-03-06T13:49:13.728022+0000","last_became_active":"2023-03-06T13:49:13.721400+0000","last_became_peered":"2023-03-06T13:49:13.721400+0000","last_unstale":"2023-03-06T13:49:13.728022+0000","last_undegraded":"2023-03-06T13:49:13.728022+0000","last_fullsized":"2023-03-06T13:49:13.728022+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T15:06:01.435712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:13.734957+0000","last_change":"2023-03-06T13:49:13.733193+0000","last_active":"2023-03-06T13:49:13.734957+0000","last_peered":"2023-03-06T13:49:13.734957+0000","last_clean":"2023-03-06T13:49:13.734957+0000","last_became_active":"2023-03-06T13:49:13.732559+0000","last_became_peered":"2023-03-06T13:49:13.732559+0000","last_unstale":"2023-03-06T13:49:13.734957+0000","last_undegraded":"2023-03-06T13:49:13.734957+0000","last_fullsized":"2023-03-06T13:49:13.734957+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T15:06:01.435712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:13.734281+0000","last_change":"2023-03-06T13:49:13.730075+0000","last_active":"2023-03-06T13:49:13.734281+0000","last_peered":"2023-03-06T13:49:13.734281+0000","last_clean":"2023-03-06T13:49:13.734281+0000","last_became_active":"2023-03-06T13:49:13.729158+0000","last_became_peered":"2023-03-06T13:49:13.729158+0000","last_unstale":"2023-03-06T13:49:13.734281+0000","last_undegraded":"2023-03-06T13:49:13.734281+0000","last_fullsized":"2023-03-06T13:49:13.734281+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T19:41:30.016073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:13.734968+0000","last_change":"2023-03-06T13:49:13.731030+0000","last_active":"2023-03-06T13:49:13.734968+0000","last_peered":"2023-03-06T13:49:13.734968+0000","last_clean":"2023-03-06T13:49:13.734968+0000","last_became_active":"2023-03-06T13:49:13.730786+0000","last_became_peered":"2023-03-06T13:49:13.730786+0000","last_unstale":"2023-03-06T13:49:13.734968+0000","last_undegraded":"2023-03-06T13:49:13.734968+0000","last_fullsized":"2023-03-06T13:49:13.734968+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T16:42:39.878112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:13.733980+0000","last_change":"2023-03-06T13:49:13.728942+0000","last_active":"2023-03-06T13:49:13.733980+0000","last_peered":"2023-03-06T13:49:13.733980+0000","last_clean":"2023-03-06T13:49:13.733980+0000","last_became_active":"2023-03-06T13:49:13.727975+0000","last_became_peered":"2023-03-06T13:49:13.727975+0000","last_unstale":"2023-03-06T13:49:13.733980+0000","last_undegraded":"2023-03-06T13:49:13.733980+0000","last_fullsized":"2023-03-06T13:49:13.733980+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T22:37:42.599167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:13.725142+0000","last_change":"2023-03-06T13:49:13.721970+0000","last_active":"2023-03-06T13:49:13.725142+0000","last_peered":"2023-03-06T13:49:13.725142+0000","last_clean":"2023-03-06T13:49:13.725142+0000","last_became_active":"2023-03-06T13:49:13.721722+0000","last_became_peered":"2023-03-06T13:49:13.721722+0000","last_unstale":"2023-03-06T13:49:13.725142+0000","last_undegraded":"2023-03-06T13:49:13.725142+0000","last_fullsized":"2023-03-06T13:49:13.725142+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T19:53:35.686308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:13.735777+0000","last_change":"2023-03-06T13:49:13.732576+0000","last_active":"2023-03-06T13:49:13.735777+0000","last_peered":"2023-03-06T13:49:13.735777+0000","last_clean":"2023-03-06T13:49:13.735777+0000","last_became_active":"2023-03-06T13:49:13.732314+0000","last_became_peered":"2023-03-06T13:49:13.732314+0000","last_unstale":"2023-03-06T13:49:13.735777+0000","last_undegraded":"2023-03-06T13:49:13.735777+0000","last_fullsized":"2023-03-06T13:49:13.735777+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T20:18:58.498628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:13.736769+0000","last_change":"2023-03-06T13:49:13.734115+0000","last_active":"2023-03-06T13:49:13.736769+0000","last_peered":"2023-03-06T13:49:13.736769+0000","last_clean":"2023-03-06T13:49:13.736769+0000","last_became_active":"2023-03-06T13:49:13.733850+0000","last_became_peered":"2023-03-06T13:49:13.733850+0000","last_unstale":"2023-03-06T13:49:13.736769+0000","last_undegraded":"2023-03-06T13:49:13.736769+0000","last_fullsized":"2023-03-06T13:49:13.736769+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T16:46:29.744316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:13.729726+0000","last_change":"2023-03-06T13:49:13.724411+0000","last_active":"2023-03-06T13:49:13.729726+0000","last_peered":"2023-03-06T13:49:13.729726+0000","last_clean":"2023-03-06T13:49:13.729726+0000","last_became_active":"2023-03-06T13:49:13.724151+0000","last_became_peered":"2023-03-06T13:49:13.724151+0000","last_unstale":"2023-03-06T13:49:13.729726+0000","last_undegraded":"2023-03-06T13:49:13.729726+0000","last_fullsized":"2023-03-06T13:49:13.729726+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T19:41:30.016073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:13.734183+0000","last_change":"2023-03-06T13:49:13.727285+0000","last_active":"2023-03-06T13:49:13.734183+0000","last_peered":"2023-03-06T13:49:13.734183+0000","last_clean":"2023-03-06T13:49:13.734183+0000","last_became_active":"2023-03-06T13:49:13.724921+0000","last_became_peered":"2023-03-06T13:49:13.724921+0000","last_unstale":"2023-03-06T13:49:13.734183+0000","last_undegraded":"2023-03-06T13:49:13.734183+0000","last_fullsized":"2023-03-06T13:49:13.734183+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-08T00:56:55.731171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:13.736634+0000","last_change":"2023-03-06T13:49:13.732435+0000","last_active":"2023-03-06T13:49:13.736634+0000","last_peered":"2023-03-06T13:49:13.736634+0000","last_clean":"2023-03-06T13:49:13.736634+0000","last_became_active":"2023-03-06T13:49:13.732118+0000","last_became_peered":"2023-03-06T13:49:13.732118+0000","last_unstale":"2023-03-06T13:49:13.736634+0000","last_undegraded":"2023-03-06T13:49:13.736634+0000","last_fullsized":"2023-03-06T13:49:13.736634+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T22:37:42.599167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-06T13:49:14.714294+0000","last_change":"2023-03-06T13:49:13.722347+0000","last_active":"2023-03-06T13:49:14.714294+0000","last_peered":"2023-03-06T13:49:14.714294+0000","last_clean":"2023-03-06T13:49:14.714294+0000","last_became_active":"2023-03-06T13:49:13.722089+0000","last_became_peered":"2023-03-06T13:49:13.722089+0000","last_unstale":"2023-03-06T13:49:14.714294+0000","last_undegraded":"2023-03-06T13:49:14.714294+0000","last_fullsized":"2023-03-06T13:49:14.714294+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T18:20:43.874725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-06T13:49:14.714475+0000","last_change":"2023-03-06T13:49:13.721459+0000","last_active":"2023-03-06T13:49:14.714475+0000","last_peered":"2023-03-06T13:49:14.714475+0000","last_clean":"2023-03-06T13:49:14.714475+0000","last_became_active":"2023-03-06T13:49:13.721210+0000","last_became_peered":"2023-03-06T13:49:13.721210+0000","last_unstale":"2023-03-06T13:49:14.714475+0000","last_undegraded":"2023-03-06T13:49:14.714475+0000","last_fullsized":"2023-03-06T13:49:14.714475+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T21:46:16.457828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:13.734332+0000","last_change":"2023-03-06T13:49:13.729761+0000","last_active":"2023-03-06T13:49:13.734332+0000","last_peered":"2023-03-06T13:49:13.734332+0000","last_clean":"2023-03-06T13:49:13.734332+0000","last_became_active":"2023-03-06T13:49:13.729301+0000","last_became_peered":"2023-03-06T13:49:13.729301+0000","last_unstale":"2023-03-06T13:49:13.734332+0000","last_undegraded":"2023-03-06T13:49:13.734332+0000","last_fullsized":"2023-03-06T13:49:13.734332+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T16:42:39.878112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"22'1","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:13.734834+0000","last_change":"2023-03-06T13:49:13.328562+0000","last_active":"2023-03-06T13:49:13.734834+0000","last_peered":"2023-03-06T13:49:13.734834+0000","last_clean":"2023-03-06T13:49:13.734834+0000","last_became_active":"2023-03-06T13:49:13.328314+0000","last_became_peered":"2023-03-06T13:49:13.328314+0000","last_unstale":"2023-03-06T13:49:13.734834+0000","last_undegraded":"2023-03-06T13:49:13.734834+0000","last_fullsized":"2023-03-06T13:49:13.734834+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_clean_scrub_stamp":"2023-03-06T13:49:12.303785+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-08T00:39:06.477914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:13.737345+0000","last_change":"2023-03-06T13:49:13.729956+0000","last_active":"2023-03-06T13:49:13.737345+0000","last_peered":"2023-03-06T13:49:13.737345+0000","last_clean":"2023-03-06T13:49:13.737345+0000","last_became_active":"2023-03-06T13:49:13.728115+0000","last_became_peered":"2023-03-06T13:49:13.728115+0000","last_unstale":"2023-03-06T13:49:13.737345+0000","last_undegraded":"2023-03-06T13:49:13.737345+0000","last_fullsized":"2023-03-06T13:49:13.737345+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T22:37:42.599167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-06T13:49:14.714081+0000","last_change":"2023-03-06T13:49:13.330148+0000","last_active":"2023-03-06T13:49:14.714081+0000","last_peered":"2023-03-06T13:49:14.714081+0000","last_clean":"2023-03-06T13:49:14.714081+0000","last_became_active":"2023-03-06T13:49:13.329874+0000","last_became_peered":"2023-03-06T13:49:13.329874+0000","last_unstale":"2023-03-06T13:49:14.714081+0000","last_undegraded":"2023-03-06T13:49:14.714081+0000","last_fullsized":"2023-03-06T13:49:14.714081+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_clean_scrub_stamp":"2023-03-06T13:49:12.303785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T14:43:51.863266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:13.730149+0000","last_change":"2023-03-06T13:49:13.726403+0000","last_active":"2023-03-06T13:49:13.730149+0000","last_peered":"2023-03-06T13:49:13.730149+0000","last_clean":"2023-03-06T13:49:13.730149+0000","last_became_active":"2023-03-06T13:49:13.726155+0000","last_became_peered":"2023-03-06T13:49:13.726155+0000","last_unstale":"2023-03-06T13:49:13.730149+0000","last_undegraded":"2023-03-06T13:49:13.730149+0000","last_fullsized":"2023-03-06T13:49:13.730149+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T18:43:12.631018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:13.713363+0000","last_change":"2023-03-06T13:49:13.333031+0000","last_active":"2023-03-06T13:49:13.713363+0000","last_peered":"2023-03-06T13:49:13.713363+0000","last_clean":"2023-03-06T13:49:13.713363+0000","last_became_active":"2023-03-06T13:49:13.332715+0000","last_became_peered":"2023-03-06T13:49:13.332715+0000","last_unstale":"2023-03-06T13:49:13.713363+0000","last_undegraded":"2023-03-06T13:49:13.713363+0000","last_fullsized":"2023-03-06T13:49:13.713363+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_clean_scrub_stamp":"2023-03-06T13:49:12.303785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T20:52:58.439733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-06T13:49:14.716097+0000","last_change":"2023-03-06T13:49:13.729931+0000","last_active":"2023-03-06T13:49:14.716097+0000","last_peered":"2023-03-06T13:49:14.716097+0000","last_clean":"2023-03-06T13:49:14.716097+0000","last_became_active":"2023-03-06T13:49:13.729657+0000","last_became_peered":"2023-03-06T13:49:13.729657+0000","last_unstale":"2023-03-06T13:49:14.716097+0000","last_undegraded":"2023-03-06T13:49:14.716097+0000","last_fullsized":"2023-03-06T13:49:14.716097+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T23:59:53.012700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:13.718171+0000","last_change":"2023-03-06T13:49:13.335979+0000","last_active":"2023-03-06T13:49:13.718171+0000","last_peered":"2023-03-06T13:49:13.718171+0000","last_clean":"2023-03-06T13:49:13.718171+0000","last_became_active":"2023-03-06T13:49:13.335701+0000","last_became_peered":"2023-03-06T13:49:13.335701+0000","last_unstale":"2023-03-06T13:49:13.718171+0000","last_undegraded":"2023-03-06T13:49:13.718171+0000","last_fullsized":"2023-03-06T13:49:13.718171+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_clean_scrub_stamp":"2023-03-06T13:49:12.303785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T19:17:35.350354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:13.727522+0000","last_change":"2023-03-06T13:49:13.721193+0000","last_active":"2023-03-06T13:49:13.727522+0000","last_peered":"2023-03-06T13:49:13.727522+0000","last_clean":"2023-03-06T13:49:13.727522+0000","last_became_active":"2023-03-06T13:49:13.720968+0000","last_became_peered":"2023-03-06T13:49:13.720968+0000","last_unstale":"2023-03-06T13:49:13.727522+0000","last_undegraded":"2023-03-06T13:49:13.727522+0000","last_fullsized":"2023-03-06T13:49:13.727522+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T16:42:39.878112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:13.714568+0000","last_change":"2023-03-06T13:49:13.336210+0000","last_active":"2023-03-06T13:49:13.714568+0000","last_peered":"2023-03-06T13:49:13.714568+0000","last_clean":"2023-03-06T13:49:13.714568+0000","last_became_active":"2023-03-06T13:49:13.335895+0000","last_became_peered":"2023-03-06T13:49:13.335895+0000","last_unstale":"2023-03-06T13:49:13.714568+0000","last_undegraded":"2023-03-06T13:49:13.714568+0000","last_fullsized":"2023-03-06T13:49:13.714568+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_clean_scrub_stamp":"2023-03-06T13:49:12.303785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T19:53:34.681954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:13.734203+0000","last_change":"2023-03-06T13:49:13.727461+0000","last_active":"2023-03-06T13:49:13.734203+0000","last_peered":"2023-03-06T13:49:13.734203+0000","last_clean":"2023-03-06T13:49:13.734203+0000","last_became_active":"2023-03-06T13:49:13.726691+0000","last_became_peered":"2023-03-06T13:49:13.726691+0000","last_unstale":"2023-03-06T13:49:13.734203+0000","last_undegraded":"2023-03-06T13:49:13.734203+0000","last_fullsized":"2023-03-06T13:49:13.734203+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-08T01:30:43.884806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"22'3","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:13.740193+0000","last_change":"2023-03-06T13:49:13.337258+0000","last_active":"2023-03-06T13:49:13.740193+0000","last_peered":"2023-03-06T13:49:13.740193+0000","last_clean":"2023-03-06T13:49:13.740193+0000","last_became_active":"2023-03-06T13:49:13.336956+0000","last_became_peered":"2023-03-06T13:49:13.336956+0000","last_unstale":"2023-03-06T13:49:13.740193+0000","last_undegraded":"2023-03-06T13:49:13.740193+0000","last_fullsized":"2023-03-06T13:49:13.740193+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_clean_scrub_stamp":"2023-03-06T13:49:12.303785+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T20:23:17.240803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-06T13:49:14.714418+0000","last_change":"2023-03-06T13:49:13.720024+0000","last_active":"2023-03-06T13:49:14.714418+0000","last_peered":"2023-03-06T13:49:14.714418+0000","last_clean":"2023-03-06T13:49:14.714418+0000","last_became_active":"2023-03-06T13:49:13.719745+0000","last_became_peered":"2023-03-06T13:49:13.719745+0000","last_unstale":"2023-03-06T13:49:14.714418+0000","last_undegraded":"2023-03-06T13:49:14.714418+0000","last_fullsized":"2023-03-06T13:49:14.714418+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T20:22:12.811857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"22'6","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:13.739135+0000","last_change":"2023-03-06T13:49:13.332863+0000","last_active":"2023-03-06T13:49:13.739135+0000","last_peered":"2023-03-06T13:49:13.739135+0000","last_clean":"2023-03-06T13:49:13.739135+0000","last_became_active":"2023-03-06T13:49:13.332579+0000","last_became_peered":"2023-03-06T13:49:13.332579+0000","last_unstale":"2023-03-06T13:49:13.739135+0000","last_undegraded":"2023-03-06T13:49:13.739135+0000","last_fullsized":"2023-03-06T13:49:13.739135+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_clean_scrub_stamp":"2023-03-06T13:49:12.303785+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T18:49:50.763848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1548,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:13.734393+0000","last_change":"2023-03-06T13:49:13.728503+0000","last_active":"2023-03-06T13:49:13.734393+0000","last_peered":"2023-03-06T13:49:13.734393+0000","last_clean":"2023-03-06T13:49:13.734393+0000","last_became_active":"2023-03-06T13:49:13.727740+0000","last_became_peered":"2023-03-06T13:49:13.727740+0000","last_unstale":"2023-03-06T13:49:13.734393+0000","last_undegraded":"2023-03-06T13:49:13.734393+0000","last_fullsized":"2023-03-06T13:49:13.734393+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-08T00:56:55.731171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.13","version":"22'2","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:13.734859+0000","last_change":"2023-03-06T13:49:13.336773+0000","last_active":"2023-03-06T13:49:13.734859+0000","last_peered":"2023-03-06T13:49:13.734859+0000","last_clean":"2023-03-06T13:49:13.734859+0000","last_became_active":"2023-03-06T13:49:13.336321+0000","last_became_peered":"2023-03-06T13:49:13.336321+0000","last_unstale":"2023-03-06T13:49:13.734859+0000","last_undegraded":"2023-03-06T13:49:13.734859+0000","last_fullsized":"2023-03-06T13:49:13.734859+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_clean_scrub_stamp":"2023-03-06T13:49:12.303785+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-08T01:45:44.452690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:13.731667+0000","last_change":"2023-03-06T13:49:13.725662+0000","last_active":"2023-03-06T13:49:13.731667+0000","last_peered":"2023-03-06T13:49:13.731667+0000","last_clean":"2023-03-06T13:49:13.731667+0000","last_became_active":"2023-03-06T13:49:13.725029+0000","last_became_peered":"2023-03-06T13:49:13.725029+0000","last_unstale":"2023-03-06T13:49:13.731667+0000","last_undegraded":"2023-03-06T13:49:13.731667+0000","last_fullsized":"2023-03-06T13:49:13.731667+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T19:41:30.016073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:13.717059+0000","last_change":"2023-03-06T13:49:13.332902+0000","last_active":"2023-03-06T13:49:13.717059+0000","last_peered":"2023-03-06T13:49:13.717059+0000","last_clean":"2023-03-06T13:49:13.717059+0000","last_became_active":"2023-03-06T13:49:13.332641+0000","last_became_peered":"2023-03-06T13:49:13.332641+0000","last_unstale":"2023-03-06T13:49:13.717059+0000","last_undegraded":"2023-03-06T13:49:13.717059+0000","last_fullsized":"2023-03-06T13:49:13.717059+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_clean_scrub_stamp":"2023-03-06T13:49:12.303785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T19:26:48.272662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:13.734314+0000","last_change":"2023-03-06T13:49:13.729557+0000","last_active":"2023-03-06T13:49:13.734314+0000","last_peered":"2023-03-06T13:49:13.734314+0000","last_clean":"2023-03-06T13:49:13.734314+0000","last_became_active":"2023-03-06T13:49:13.728917+0000","last_became_peered":"2023-03-06T13:49:13.728917+0000","last_unstale":"2023-03-06T13:49:13.734314+0000","last_undegraded":"2023-03-06T13:49:13.734314+0000","last_fullsized":"2023-03-06T13:49:13.734314+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T18:43:12.631018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:13.717025+0000","last_change":"2023-03-06T13:49:13.337738+0000","last_active":"2023-03-06T13:49:13.717025+0000","last_peered":"2023-03-06T13:49:13.717025+0000","last_clean":"2023-03-06T13:49:13.717025+0000","last_became_active":"2023-03-06T13:49:13.337441+0000","last_became_peered":"2023-03-06T13:49:13.337441+0000","last_unstale":"2023-03-06T13:49:13.717025+0000","last_undegraded":"2023-03-06T13:49:13.717025+0000","last_fullsized":"2023-03-06T13:49:13.717025+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_clean_scrub_stamp":"2023-03-06T13:49:12.303785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T19:17:35.350354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:13.730131+0000","last_change":"2023-03-06T13:49:13.725893+0000","last_active":"2023-03-06T13:49:13.730131+0000","last_peered":"2023-03-06T13:49:13.730131+0000","last_clean":"2023-03-06T13:49:13.730131+0000","last_became_active":"2023-03-06T13:49:13.725632+0000","last_became_peered":"2023-03-06T13:49:13.725632+0000","last_unstale":"2023-03-06T13:49:13.730131+0000","last_undegraded":"2023-03-06T13:49:13.730131+0000","last_fullsized":"2023-03-06T13:49:13.730131+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-08T00:56:55.731171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"22'8","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-06T13:49:14.715336+0000","last_change":"2023-03-06T13:49:13.325572+0000","last_active":"2023-03-06T13:49:14.715336+0000","last_peered":"2023-03-06T13:49:14.715336+0000","last_clean":"2023-03-06T13:49:14.715336+0000","last_became_active":"2023-03-06T13:49:13.325252+0000","last_became_peered":"2023-03-06T13:49:13.325252+0000","last_unstale":"2023-03-06T13:49:14.715336+0000","last_undegraded":"2023-03-06T13:49:14.715336+0000","last_fullsized":"2023-03-06T13:49:14.715336+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_clean_scrub_stamp":"2023-03-06T13:49:12.303785+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T18:49:50.763848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:13.737083+0000","last_change":"2023-03-06T13:49:13.730932+0000","last_active":"2023-03-06T13:49:13.737083+0000","last_peered":"2023-03-06T13:49:13.737083+0000","last_clean":"2023-03-06T13:49:13.737083+0000","last_became_active":"2023-03-06T13:49:13.728504+0000","last_became_peered":"2023-03-06T13:49:13.728504+0000","last_unstale":"2023-03-06T13:49:13.737083+0000","last_undegraded":"2023-03-06T13:49:13.737083+0000","last_fullsized":"2023-03-06T13:49:13.737083+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T16:46:29.744316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"22'1","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:13.736956+0000","last_change":"2023-03-06T13:49:13.336765+0000","last_active":"2023-03-06T13:49:13.736956+0000","last_peered":"2023-03-06T13:49:13.736956+0000","last_clean":"2023-03-06T13:49:13.736956+0000","last_became_active":"2023-03-06T13:49:13.336364+0000","last_became_peered":"2023-03-06T13:49:13.336364+0000","last_unstale":"2023-03-06T13:49:13.736956+0000","last_undegraded":"2023-03-06T13:49:13.736956+0000","last_fullsized":"2023-03-06T13:49:13.736956+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_clean_scrub_stamp":"2023-03-06T13:49:12.303785+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T23:59:52.008346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:13.728159+0000","last_change":"2023-03-06T13:49:13.725154+0000","last_active":"2023-03-06T13:49:13.728159+0000","last_peered":"2023-03-06T13:49:13.728159+0000","last_clean":"2023-03-06T13:49:13.728159+0000","last_became_active":"2023-03-06T13:49:13.724853+0000","last_became_peered":"2023-03-06T13:49:13.724853+0000","last_unstale":"2023-03-06T13:49:13.728159+0000","last_undegraded":"2023-03-06T13:49:13.728159+0000","last_fullsized":"2023-03-06T13:49:13.728159+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T23:04:29.575987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"22'2","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:13.737334+0000","last_change":"2023-03-06T13:49:13.336914+0000","last_active":"2023-03-06T13:49:13.737334+0000","last_peered":"2023-03-06T13:49:13.737334+0000","last_clean":"2023-03-06T13:49:13.737334+0000","last_became_active":"2023-03-06T13:49:13.336552+0000","last_became_peered":"2023-03-06T13:49:13.336552+0000","last_unstale":"2023-03-06T13:49:13.737334+0000","last_undegraded":"2023-03-06T13:49:13.737334+0000","last_fullsized":"2023-03-06T13:49:13.737334+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_clean_scrub_stamp":"2023-03-06T13:49:12.303785+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T16:21:43.998829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:13.734089+0000","last_change":"2023-03-06T13:49:13.730794+0000","last_active":"2023-03-06T13:49:13.734089+0000","last_peered":"2023-03-06T13:49:13.734089+0000","last_clean":"2023-03-06T13:49:13.734089+0000","last_became_active":"2023-03-06T13:49:13.730504+0000","last_became_peered":"2023-03-06T13:49:13.730504+0000","last_unstale":"2023-03-06T13:49:13.734089+0000","last_undegraded":"2023-03-06T13:49:13.734089+0000","last_fullsized":"2023-03-06T13:49:13.734089+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T23:04:29.575987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"22'1","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:13.737342+0000","last_change":"2023-03-06T13:49:13.335019+0000","last_active":"2023-03-06T13:49:13.737342+0000","last_peered":"2023-03-06T13:49:13.737342+0000","last_clean":"2023-03-06T13:49:13.737342+0000","last_became_active":"2023-03-06T13:49:13.334748+0000","last_became_peered":"2023-03-06T13:49:13.334748+0000","last_unstale":"2023-03-06T13:49:13.737342+0000","last_undegraded":"2023-03-06T13:49:13.737342+0000","last_fullsized":"2023-03-06T13:49:13.737342+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_clean_scrub_stamp":"2023-03-06T13:49:12.303785+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T18:44:54.544875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-06T13:49:14.715551+0000","last_change":"2023-03-06T13:49:13.722448+0000","last_active":"2023-03-06T13:49:14.715551+0000","last_peered":"2023-03-06T13:49:14.715551+0000","last_clean":"2023-03-06T13:49:14.715551+0000","last_became_active":"2023-03-06T13:49:13.719433+0000","last_became_peered":"2023-03-06T13:49:13.719433+0000","last_unstale":"2023-03-06T13:49:14.715551+0000","last_undegraded":"2023-03-06T13:49:14.715551+0000","last_fullsized":"2023-03-06T13:49:14.715551+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T19:17:36.354708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:13.713511+0000","last_change":"2023-03-06T13:49:13.329213+0000","last_active":"2023-03-06T13:49:13.713511+0000","last_peered":"2023-03-06T13:49:13.713511+0000","last_clean":"2023-03-06T13:49:13.713511+0000","last_became_active":"2023-03-06T13:49:13.328881+0000","last_became_peered":"2023-03-06T13:49:13.328881+0000","last_unstale":"2023-03-06T13:49:13.713511+0000","last_undegraded":"2023-03-06T13:49:13.713511+0000","last_fullsized":"2023-03-06T13:49:13.713511+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_clean_scrub_stamp":"2023-03-06T13:49:12.303785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-08T01:45:44.452690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:13.728947+0000","last_change":"2023-03-06T13:49:13.722967+0000","last_active":"2023-03-06T13:49:13.728947+0000","last_peered":"2023-03-06T13:49:13.728947+0000","last_clean":"2023-03-06T13:49:13.728947+0000","last_became_active":"2023-03-06T13:49:13.722502+0000","last_became_peered":"2023-03-06T13:49:13.722502+0000","last_unstale":"2023-03-06T13:49:13.728947+0000","last_undegraded":"2023-03-06T13:49:13.728947+0000","last_fullsized":"2023-03-06T13:49:13.728947+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T16:46:29.744316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"22'2","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:13.730633+0000","last_change":"2023-03-06T13:49:13.334295+0000","last_active":"2023-03-06T13:49:13.730633+0000","last_peered":"2023-03-06T13:49:13.730633+0000","last_clean":"2023-03-06T13:49:13.730633+0000","last_became_active":"2023-03-06T13:49:13.334029+0000","last_became_peered":"2023-03-06T13:49:13.334029+0000","last_unstale":"2023-03-06T13:49:13.730633+0000","last_undegraded":"2023-03-06T13:49:13.730633+0000","last_fullsized":"2023-03-06T13:49:13.730633+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_clean_scrub_stamp":"2023-03-06T13:49:12.303785+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T17:43:02.141473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:13.737686+0000","last_change":"2023-03-06T13:49:13.735942+0000","last_active":"2023-03-06T13:49:13.737686+0000","last_peered":"2023-03-06T13:49:13.737686+0000","last_clean":"2023-03-06T13:49:13.737686+0000","last_became_active":"2023-03-06T13:49:13.735605+0000","last_became_peered":"2023-03-06T13:49:13.735605+0000","last_unstale":"2023-03-06T13:49:13.737686+0000","last_undegraded":"2023-03-06T13:49:13.737686+0000","last_fullsized":"2023-03-06T13:49:13.737686+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-08T01:35:08.480796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-06T13:49:14.715543+0000","last_change":"2023-03-06T13:49:13.334902+0000","last_active":"2023-03-06T13:49:14.715543+0000","last_peered":"2023-03-06T13:49:14.715543+0000","last_clean":"2023-03-06T13:49:14.715543+0000","last_became_active":"2023-03-06T13:49:13.334117+0000","last_became_peered":"2023-03-06T13:49:13.334117+0000","last_unstale":"2023-03-06T13:49:14.715543+0000","last_undegraded":"2023-03-06T13:49:14.715543+0000","last_fullsized":"2023-03-06T13:49:14.715543+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_clean_scrub_stamp":"2023-03-06T13:49:12.303785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T19:15:21.274175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:13.736904+0000","last_change":"2023-03-06T13:49:13.735438+0000","last_active":"2023-03-06T13:49:13.736904+0000","last_peered":"2023-03-06T13:49:13.736904+0000","last_clean":"2023-03-06T13:49:13.736904+0000","last_became_active":"2023-03-06T13:49:13.734124+0000","last_became_peered":"2023-03-06T13:49:13.734124+0000","last_unstale":"2023-03-06T13:49:13.736904+0000","last_undegraded":"2023-03-06T13:49:13.736904+0000","last_fullsized":"2023-03-06T13:49:13.736904+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T21:05:03.457340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:13.723257+0000","last_change":"2023-03-06T13:49:13.331505+0000","last_active":"2023-03-06T13:49:13.723257+0000","last_peered":"2023-03-06T13:49:13.723257+0000","last_clean":"2023-03-06T13:49:13.723257+0000","last_became_active":"2023-03-06T13:49:13.331213+0000","last_became_peered":"2023-03-06T13:49:13.331213+0000","last_unstale":"2023-03-06T13:49:13.723257+0000","last_undegraded":"2023-03-06T13:49:13.723257+0000","last_fullsized":"2023-03-06T13:49:13.723257+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_clean_scrub_stamp":"2023-03-06T13:49:12.303785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T14:43:51.863266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:13.734128+0000","last_change":"2023-03-06T13:49:13.731378+0000","last_active":"2023-03-06T13:49:13.734128+0000","last_peered":"2023-03-06T13:49:13.734128+0000","last_clean":"2023-03-06T13:49:13.734128+0000","last_became_active":"2023-03-06T13:49:13.729527+0000","last_became_peered":"2023-03-06T13:49:13.729527+0000","last_unstale":"2023-03-06T13:49:13.734128+0000","last_undegraded":"2023-03-06T13:49:13.734128+0000","last_fullsized":"2023-03-06T13:49:13.734128+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T17:11:13.619652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:13.713244+0000","last_change":"2023-03-06T13:49:13.333554+0000","last_active":"2023-03-06T13:49:13.713244+0000","last_peered":"2023-03-06T13:49:13.713244+0000","last_clean":"2023-03-06T13:49:13.713244+0000","last_became_active":"2023-03-06T13:49:13.333290+0000","last_became_peered":"2023-03-06T13:49:13.333290+0000","last_unstale":"2023-03-06T13:49:13.713244+0000","last_undegraded":"2023-03-06T13:49:13.713244+0000","last_fullsized":"2023-03-06T13:49:13.713244+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_clean_scrub_stamp":"2023-03-06T13:49:12.303785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T19:53:34.681954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-06T13:49:14.714385+0000","last_change":"2023-03-06T13:49:13.727168+0000","last_active":"2023-03-06T13:49:14.714385+0000","last_peered":"2023-03-06T13:49:14.714385+0000","last_clean":"2023-03-06T13:49:14.714385+0000","last_became_active":"2023-03-06T13:49:13.726711+0000","last_became_peered":"2023-03-06T13:49:13.726711+0000","last_unstale":"2023-03-06T13:49:14.714385+0000","last_undegraded":"2023-03-06T13:49:14.714385+0000","last_fullsized":"2023-03-06T13:49:14.714385+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T19:41:30.016073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:13.714161+0000","last_change":"2023-03-06T13:49:08.699699+0000","last_active":"2023-03-06T13:49:13.714161+0000","last_peered":"2023-03-06T13:49:13.714161+0000","last_clean":"2023-03-06T13:49:13.714161+0000","last_became_active":"2023-03-06T13:49:08.699396+0000","last_became_peered":"2023-03-06T13:49:08.699396+0000","last_unstale":"2023-03-06T13:49:13.714161+0000","last_undegraded":"2023-03-06T13:49:13.714161+0000","last_fullsized":"2023-03-06T13:49:13.714161+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:07.278421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:07.278421+0000","last_clean_scrub_stamp":"2023-03-06T13:49:07.278421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-08T01:22:20.301600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:13.714388+0000","last_change":"2023-03-06T13:49:13.336126+0000","last_active":"2023-03-06T13:49:13.714388+0000","last_peered":"2023-03-06T13:49:13.714388+0000","last_clean":"2023-03-06T13:49:13.714388+0000","last_became_active":"2023-03-06T13:49:13.335530+0000","last_became_peered":"2023-03-06T13:49:13.335530+0000","last_unstale":"2023-03-06T13:49:13.714388+0000","last_undegraded":"2023-03-06T13:49:13.714388+0000","last_fullsized":"2023-03-06T13:49:13.714388+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_clean_scrub_stamp":"2023-03-06T13:49:12.303785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T16:21:43.998829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-06T13:49:14.714365+0000","last_change":"2023-03-06T13:49:13.727824+0000","last_active":"2023-03-06T13:49:14.714365+0000","last_peered":"2023-03-06T13:49:14.714365+0000","last_clean":"2023-03-06T13:49:14.714365+0000","last_became_active":"2023-03-06T13:49:13.727472+0000","last_became_peered":"2023-03-06T13:49:13.727472+0000","last_unstale":"2023-03-06T13:49:14.714365+0000","last_undegraded":"2023-03-06T13:49:14.714365+0000","last_fullsized":"2023-03-06T13:49:14.714365+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T22:37:42.599167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-03-06T13:49:13.327993+0000","last_change":"2023-03-06T13:49:08.306975+0000","last_active":"2023-03-06T13:49:13.327993+0000","last_peered":"2023-03-06T13:49:13.327993+0000","last_clean":"2023-03-06T13:49:13.327993+0000","last_became_active":"2023-03-06T13:49:08.306669+0000","last_became_peered":"2023-03-06T13:49:08.306669+0000","last_unstale":"2023-03-06T13:49:13.327993+0000","last_undegraded":"2023-03-06T13:49:13.327993+0000","last_fullsized":"2023-03-06T13:49:13.327993+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:07.278421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:07.278421+0000","last_clean_scrub_stamp":"2023-03-06T13:49:07.278421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T19:54:04.557386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:13.724620+0000","last_change":"2023-03-06T13:49:13.327601+0000","last_active":"2023-03-06T13:49:13.724620+0000","last_peered":"2023-03-06T13:49:13.724620+0000","last_clean":"2023-03-06T13:49:13.724620+0000","last_became_active":"2023-03-06T13:49:13.327317+0000","last_became_peered":"2023-03-06T13:49:13.327317+0000","last_unstale":"2023-03-06T13:49:13.724620+0000","last_undegraded":"2023-03-06T13:49:13.724620+0000","last_fullsized":"2023-03-06T13:49:13.724620+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_clean_scrub_stamp":"2023-03-06T13:49:12.303785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T19:15:21.274175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-06T13:49:14.714429+0000","last_change":"2023-03-06T13:49:13.728830+0000","last_active":"2023-03-06T13:49:14.714429+0000","last_peered":"2023-03-06T13:49:14.714429+0000","last_clean":"2023-03-06T13:49:14.714429+0000","last_became_active":"2023-03-06T13:49:13.726036+0000","last_became_peered":"2023-03-06T13:49:13.726036+0000","last_unstale":"2023-03-06T13:49:14.714429+0000","last_undegraded":"2023-03-06T13:49:14.714429+0000","last_fullsized":"2023-03-06T13:49:14.714429+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T15:06:01.435712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-03-06T13:49:13.327233+0000","last_change":"2023-03-06T13:49:08.314061+0000","last_active":"2023-03-06T13:49:13.327233+0000","last_peered":"2023-03-06T13:49:13.327233+0000","last_clean":"2023-03-06T13:49:13.327233+0000","last_became_active":"2023-03-06T13:49:08.313713+0000","last_became_peered":"2023-03-06T13:49:08.313713+0000","last_unstale":"2023-03-06T13:49:13.327233+0000","last_undegraded":"2023-03-06T13:49:13.327233+0000","last_fullsized":"2023-03-06T13:49:13.327233+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:07.278421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:07.278421+0000","last_clean_scrub_stamp":"2023-03-06T13:49:07.278421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T15:29:35.587025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-06T13:49:14.713974+0000","last_change":"2023-03-06T13:49:13.331494+0000","last_active":"2023-03-06T13:49:14.713974+0000","last_peered":"2023-03-06T13:49:14.713974+0000","last_clean":"2023-03-06T13:49:14.713974+0000","last_became_active":"2023-03-06T13:49:13.331229+0000","last_became_peered":"2023-03-06T13:49:13.331229+0000","last_unstale":"2023-03-06T13:49:14.713974+0000","last_undegraded":"2023-03-06T13:49:14.713974+0000","last_fullsized":"2023-03-06T13:49:14.713974+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_clean_scrub_stamp":"2023-03-06T13:49:12.303785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T19:53:34.681954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-06T13:49:14.714342+0000","last_change":"2023-03-06T13:49:13.727756+0000","last_active":"2023-03-06T13:49:14.714342+0000","last_peered":"2023-03-06T13:49:14.714342+0000","last_clean":"2023-03-06T13:49:14.714342+0000","last_became_active":"2023-03-06T13:49:13.727509+0000","last_became_peered":"2023-03-06T13:49:13.727509+0000","last_unstale":"2023-03-06T13:49:14.714342+0000","last_undegraded":"2023-03-06T13:49:14.714342+0000","last_fullsized":"2023-03-06T13:49:14.714342+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T16:46:29.744316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-03-06T13:49:13.327616+0000","last_change":"2023-03-06T13:49:08.307053+0000","last_active":"2023-03-06T13:49:13.327616+0000","last_peered":"2023-03-06T13:49:13.327616+0000","last_clean":"2023-03-06T13:49:13.327616+0000","last_became_active":"2023-03-06T13:49:08.306737+0000","last_became_peered":"2023-03-06T13:49:08.306737+0000","last_unstale":"2023-03-06T13:49:13.327616+0000","last_undegraded":"2023-03-06T13:49:13.327616+0000","last_fullsized":"2023-03-06T13:49:13.327616+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:07.278421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:07.278421+0000","last_clean_scrub_stamp":"2023-03-06T13:49:07.278421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T21:59:33.265276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":166,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-03-06T13:49:13.326492+0000","last_change":"2023-03-06T13:49:01.912106+0000","last_active":"2023-03-06T13:49:13.326492+0000","last_peered":"2023-03-06T13:49:13.326492+0000","last_clean":"2023-03-06T13:49:13.326492+0000","last_became_active":"2023-03-06T13:49:01.911157+0000","last_became_peered":"2023-03-06T13:49:01.911157+0000","last_unstale":"2023-03-06T13:49:13.326492+0000","last_undegraded":"2023-03-06T13:49:13.326492+0000","last_fullsized":"2023-03-06T13:49:13.326492+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:00.859533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:00.859533+0000","last_clean_scrub_stamp":"2023-03-06T13:49:00.859533+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T21:39:16.753876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:13.712992+0000","last_change":"2023-03-06T13:49:13.335291+0000","last_active":"2023-03-06T13:49:13.712992+0000","last_peered":"2023-03-06T13:49:13.712992+0000","last_clean":"2023-03-06T13:49:13.712992+0000","last_became_active":"2023-03-06T13:49:13.334976+0000","last_became_peered":"2023-03-06T13:49:13.334976+0000","last_unstale":"2023-03-06T13:49:13.712992+0000","last_undegraded":"2023-03-06T13:49:13.712992+0000","last_fullsized":"2023-03-06T13:49:13.712992+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_clean_scrub_stamp":"2023-03-06T13:49:12.303785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-08T01:45:44.452690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-06T13:49:14.715835+0000","last_change":"2023-03-06T13:49:13.730668+0000","last_active":"2023-03-06T13:49:14.715835+0000","last_peered":"2023-03-06T13:49:14.715835+0000","last_clean":"2023-03-06T13:49:14.715835+0000","last_became_active":"2023-03-06T13:49:13.730191+0000","last_became_peered":"2023-03-06T13:49:13.730191+0000","last_unstale":"2023-03-06T13:49:14.715835+0000","last_undegraded":"2023-03-06T13:49:14.715835+0000","last_fullsized":"2023-03-06T13:49:14.715835+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T20:23:18.245157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-03-06T13:49:13.326603+0000","last_change":"2023-03-06T13:49:08.307071+0000","last_active":"2023-03-06T13:49:13.326603+0000","last_peered":"2023-03-06T13:49:13.326603+0000","last_clean":"2023-03-06T13:49:13.326603+0000","last_became_active":"2023-03-06T13:49:08.306682+0000","last_became_peered":"2023-03-06T13:49:08.306682+0000","last_unstale":"2023-03-06T13:49:13.326603+0000","last_undegraded":"2023-03-06T13:49:13.326603+0000","last_fullsized":"2023-03-06T13:49:13.326603+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:07.278421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:07.278421+0000","last_clean_scrub_stamp":"2023-03-06T13:49:07.278421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T19:54:04.557386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:13.716963+0000","last_change":"2023-03-06T13:49:13.331989+0000","last_active":"2023-03-06T13:49:13.716963+0000","last_peered":"2023-03-06T13:49:13.716963+0000","last_clean":"2023-03-06T13:49:13.716963+0000","last_became_active":"2023-03-06T13:49:13.331679+0000","last_became_peered":"2023-03-06T13:49:13.331679+0000","last_unstale":"2023-03-06T13:49:13.716963+0000","last_undegraded":"2023-03-06T13:49:13.716963+0000","last_fullsized":"2023-03-06T13:49:13.716963+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_clean_scrub_stamp":"2023-03-06T13:49:12.303785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T19:53:34.681954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:13.728704+0000","last_change":"2023-03-06T13:49:13.722056+0000","last_active":"2023-03-06T13:49:13.728704+0000","last_peered":"2023-03-06T13:49:13.728704+0000","last_clean":"2023-03-06T13:49:13.728704+0000","last_became_active":"2023-03-06T13:49:13.721792+0000","last_became_peered":"2023-03-06T13:49:13.721792+0000","last_unstale":"2023-03-06T13:49:13.728704+0000","last_undegraded":"2023-03-06T13:49:13.728704+0000","last_fullsized":"2023-03-06T13:49:13.728704+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T22:37:42.599167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-03-06T13:49:13.327257+0000","last_change":"2023-03-06T13:49:08.699801+0000","last_active":"2023-03-06T13:49:13.327257+0000","last_peered":"2023-03-06T13:49:13.327257+0000","last_clean":"2023-03-06T13:49:13.327257+0000","last_became_active":"2023-03-06T13:49:08.699514+0000","last_became_peered":"2023-03-06T13:49:08.699514+0000","last_unstale":"2023-03-06T13:49:13.327257+0000","last_undegraded":"2023-03-06T13:49:13.327257+0000","last_fullsized":"2023-03-06T13:49:13.327257+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:07.278421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:07.278421+0000","last_clean_scrub_stamp":"2023-03-06T13:49:07.278421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-08T00:50:49.893386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-06T13:49:14.714510+0000","last_change":"2023-03-06T13:49:13.332420+0000","last_active":"2023-03-06T13:49:14.714510+0000","last_peered":"2023-03-06T13:49:14.714510+0000","last_clean":"2023-03-06T13:49:14.714510+0000","last_became_active":"2023-03-06T13:49:13.332115+0000","last_became_peered":"2023-03-06T13:49:13.332115+0000","last_unstale":"2023-03-06T13:49:14.714510+0000","last_undegraded":"2023-03-06T13:49:14.714510+0000","last_fullsized":"2023-03-06T13:49:14.714510+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_clean_scrub_stamp":"2023-03-06T13:49:12.303785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T20:52:58.439733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:13.729882+0000","last_change":"2023-03-06T13:49:13.728080+0000","last_active":"2023-03-06T13:49:13.729882+0000","last_peered":"2023-03-06T13:49:13.729882+0000","last_clean":"2023-03-06T13:49:13.729882+0000","last_became_active":"2023-03-06T13:49:13.727805+0000","last_became_peered":"2023-03-06T13:49:13.727805+0000","last_unstale":"2023-03-06T13:49:13.729882+0000","last_undegraded":"2023-03-06T13:49:13.729882+0000","last_fullsized":"2023-03-06T13:49:13.729882+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-08T01:30:43.884806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"22'2","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:13.730457+0000","last_change":"2023-03-06T13:49:13.333399+0000","last_active":"2023-03-06T13:49:13.730457+0000","last_peered":"2023-03-06T13:49:13.730457+0000","last_clean":"2023-03-06T13:49:13.730457+0000","last_became_active":"2023-03-06T13:49:13.333083+0000","last_became_peered":"2023-03-06T13:49:13.333083+0000","last_unstale":"2023-03-06T13:49:13.730457+0000","last_undegraded":"2023-03-06T13:49:13.730457+0000","last_fullsized":"2023-03-06T13:49:13.730457+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_clean_scrub_stamp":"2023-03-06T13:49:12.303785+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T19:26:48.272662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:13.714043+0000","last_change":"2023-03-06T13:49:08.303113+0000","last_active":"2023-03-06T13:49:13.714043+0000","last_peered":"2023-03-06T13:49:13.714043+0000","last_clean":"2023-03-06T13:49:13.714043+0000","last_became_active":"2023-03-06T13:49:08.302803+0000","last_became_peered":"2023-03-06T13:49:08.302803+0000","last_unstale":"2023-03-06T13:49:13.714043+0000","last_undegraded":"2023-03-06T13:49:13.714043+0000","last_fullsized":"2023-03-06T13:49:13.714043+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:07.278421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:07.278421+0000","last_clean_scrub_stamp":"2023-03-06T13:49:07.278421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T15:29:35.587025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:13.730332+0000","last_change":"2023-03-06T13:49:13.726793+0000","last_active":"2023-03-06T13:49:13.730332+0000","last_peered":"2023-03-06T13:49:13.730332+0000","last_clean":"2023-03-06T13:49:13.730332+0000","last_became_active":"2023-03-06T13:49:13.726528+0000","last_became_peered":"2023-03-06T13:49:13.726528+0000","last_unstale":"2023-03-06T13:49:13.730332+0000","last_undegraded":"2023-03-06T13:49:13.730332+0000","last_fullsized":"2023-03-06T13:49:13.730332+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T17:11:13.619652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:13.714479+0000","last_change":"2023-03-06T13:49:08.302357+0000","last_active":"2023-03-06T13:49:13.714479+0000","last_peered":"2023-03-06T13:49:13.714479+0000","last_clean":"2023-03-06T13:49:13.714479+0000","last_became_active":"2023-03-06T13:49:08.302038+0000","last_became_peered":"2023-03-06T13:49:08.302038+0000","last_unstale":"2023-03-06T13:49:13.714479+0000","last_undegraded":"2023-03-06T13:49:13.714479+0000","last_fullsized":"2023-03-06T13:49:13.714479+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:07.278421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:07.278421+0000","last_clean_scrub_stamp":"2023-03-06T13:49:07.278421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-08T01:22:20.301600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:13.717093+0000","last_change":"2023-03-06T13:49:13.327179+0000","last_active":"2023-03-06T13:49:13.717093+0000","last_peered":"2023-03-06T13:49:13.717093+0000","last_clean":"2023-03-06T13:49:13.717093+0000","last_became_active":"2023-03-06T13:49:13.326813+0000","last_became_peered":"2023-03-06T13:49:13.326813+0000","last_unstale":"2023-03-06T13:49:13.717093+0000","last_undegraded":"2023-03-06T13:49:13.717093+0000","last_fullsized":"2023-03-06T13:49:13.717093+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_clean_scrub_stamp":"2023-03-06T13:49:12.303785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-08T01:45:44.452690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:13.736313+0000","last_change":"2023-03-06T13:49:13.733789+0000","last_active":"2023-03-06T13:49:13.736313+0000","last_peered":"2023-03-06T13:49:13.736313+0000","last_clean":"2023-03-06T13:49:13.736313+0000","last_became_active":"2023-03-06T13:49:13.733499+0000","last_became_peered":"2023-03-06T13:49:13.733499+0000","last_unstale":"2023-03-06T13:49:13.736313+0000","last_undegraded":"2023-03-06T13:49:13.736313+0000","last_fullsized":"2023-03-06T13:49:13.736313+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-08T00:51:17.885729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"22'1","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:13.733563+0000","last_change":"2023-03-06T13:49:13.330776+0000","last_active":"2023-03-06T13:49:13.733563+0000","last_peered":"2023-03-06T13:49:13.733563+0000","last_clean":"2023-03-06T13:49:13.733563+0000","last_became_active":"2023-03-06T13:49:13.330380+0000","last_became_peered":"2023-03-06T13:49:13.330380+0000","last_unstale":"2023-03-06T13:49:13.733563+0000","last_undegraded":"2023-03-06T13:49:13.733563+0000","last_fullsized":"2023-03-06T13:49:13.733563+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_clean_scrub_stamp":"2023-03-06T13:49:12.303785+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T16:21:43.998829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:13.725303+0000","last_change":"2023-03-06T13:49:13.721742+0000","last_active":"2023-03-06T13:49:13.725303+0000","last_peered":"2023-03-06T13:49:13.725303+0000","last_clean":"2023-03-06T13:49:13.725303+0000","last_became_active":"2023-03-06T13:49:13.721486+0000","last_became_peered":"2023-03-06T13:49:13.721486+0000","last_unstale":"2023-03-06T13:49:13.725303+0000","last_undegraded":"2023-03-06T13:49:13.725303+0000","last_fullsized":"2023-03-06T13:49:13.725303+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T19:26:49.277016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"22'2","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:13.735662+0000","last_change":"2023-03-06T13:49:13.335557+0000","last_active":"2023-03-06T13:49:13.735662+0000","last_peered":"2023-03-06T13:49:13.735662+0000","last_clean":"2023-03-06T13:49:13.735662+0000","last_became_active":"2023-03-06T13:49:13.335187+0000","last_became_peered":"2023-03-06T13:49:13.335187+0000","last_unstale":"2023-03-06T13:49:13.735662+0000","last_undegraded":"2023-03-06T13:49:13.735662+0000","last_fullsized":"2023-03-06T13:49:13.735662+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_clean_scrub_stamp":"2023-03-06T13:49:12.303785+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T20:23:17.240803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:13.737123+0000","last_change":"2023-03-06T13:49:13.735885+0000","last_active":"2023-03-06T13:49:13.737123+0000","last_peered":"2023-03-06T13:49:13.737123+0000","last_clean":"2023-03-06T13:49:13.737123+0000","last_became_active":"2023-03-06T13:49:13.735406+0000","last_became_peered":"2023-03-06T13:49:13.735406+0000","last_unstale":"2023-03-06T13:49:13.737123+0000","last_undegraded":"2023-03-06T13:49:13.737123+0000","last_fullsized":"2023-03-06T13:49:13.737123+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T20:35:34.805878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"22'2","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:13.731520+0000","last_change":"2023-03-06T13:49:13.331444+0000","last_active":"2023-03-06T13:49:13.731520+0000","last_peered":"2023-03-06T13:49:13.731520+0000","last_clean":"2023-03-06T13:49:13.731520+0000","last_became_active":"2023-03-06T13:49:13.331144+0000","last_became_peered":"2023-03-06T13:49:13.331144+0000","last_unstale":"2023-03-06T13:49:13.731520+0000","last_undegraded":"2023-03-06T13:49:13.731520+0000","last_fullsized":"2023-03-06T13:49:13.731520+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_clean_scrub_stamp":"2023-03-06T13:49:12.303785+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T19:17:35.350354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:13.737308+0000","last_change":"2023-03-06T13:49:13.736068+0000","last_active":"2023-03-06T13:49:13.737308+0000","last_peered":"2023-03-06T13:49:13.737308+0000","last_clean":"2023-03-06T13:49:13.737308+0000","last_became_active":"2023-03-06T13:49:13.735570+0000","last_became_peered":"2023-03-06T13:49:13.735570+0000","last_unstale":"2023-03-06T13:49:13.737308+0000","last_undegraded":"2023-03-06T13:49:13.737308+0000","last_fullsized":"2023-03-06T13:49:13.737308+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T20:03:32.232238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"22'1","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:13.733823+0000","last_change":"2023-03-06T13:49:13.328915+0000","last_active":"2023-03-06T13:49:13.733823+0000","last_peered":"2023-03-06T13:49:13.733823+0000","last_clean":"2023-03-06T13:49:13.733823+0000","last_became_active":"2023-03-06T13:49:13.328550+0000","last_became_peered":"2023-03-06T13:49:13.328550+0000","last_unstale":"2023-03-06T13:49:13.733823+0000","last_undegraded":"2023-03-06T13:49:13.733823+0000","last_fullsized":"2023-03-06T13:49:13.733823+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_clean_scrub_stamp":"2023-03-06T13:49:12.303785+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T14:43:51.863266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:13.734221+0000","last_change":"2023-03-06T13:49:13.727624+0000","last_active":"2023-03-06T13:49:13.734221+0000","last_peered":"2023-03-06T13:49:13.734221+0000","last_clean":"2023-03-06T13:49:13.734221+0000","last_became_active":"2023-03-06T13:49:13.727000+0000","last_became_peered":"2023-03-06T13:49:13.727000+0000","last_unstale":"2023-03-06T13:49:13.734221+0000","last_undegraded":"2023-03-06T13:49:13.734221+0000","last_fullsized":"2023-03-06T13:49:13.734221+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T15:06:01.435712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"22'4","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:13.730223+0000","last_change":"2023-03-06T13:49:13.334970+0000","last_active":"2023-03-06T13:49:13.730223+0000","last_peered":"2023-03-06T13:49:13.730223+0000","last_clean":"2023-03-06T13:49:13.730223+0000","last_became_active":"2023-03-06T13:49:13.334697+0000","last_became_peered":"2023-03-06T13:49:13.334697+0000","last_unstale":"2023-03-06T13:49:13.730223+0000","last_undegraded":"2023-03-06T13:49:13.730223+0000","last_fullsized":"2023-03-06T13:49:13.730223+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_clean_scrub_stamp":"2023-03-06T13:49:12.303785+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T20:23:17.240803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":566,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:13.734259+0000","last_change":"2023-03-06T13:49:13.728290+0000","last_active":"2023-03-06T13:49:13.734259+0000","last_peered":"2023-03-06T13:49:13.734259+0000","last_clean":"2023-03-06T13:49:13.734259+0000","last_became_active":"2023-03-06T13:49:13.727708+0000","last_became_peered":"2023-03-06T13:49:13.727708+0000","last_unstale":"2023-03-06T13:49:13.734259+0000","last_undegraded":"2023-03-06T13:49:13.734259+0000","last_fullsized":"2023-03-06T13:49:13.734259+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T16:42:39.878112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-06T13:49:14.715385+0000","last_change":"2023-03-06T13:49:13.723965+0000","last_active":"2023-03-06T13:49:14.715385+0000","last_peered":"2023-03-06T13:49:14.715385+0000","last_clean":"2023-03-06T13:49:14.715385+0000","last_became_active":"2023-03-06T13:49:13.723661+0000","last_became_peered":"2023-03-06T13:49:13.723661+0000","last_unstale":"2023-03-06T13:49:14.715385+0000","last_undegraded":"2023-03-06T13:49:14.715385+0000","last_fullsized":"2023-03-06T13:49:14.715385+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T23:31:39.512892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:13.737159+0000","last_change":"2023-03-06T13:49:13.731877+0000","last_active":"2023-03-06T13:49:13.737159+0000","last_peered":"2023-03-06T13:49:13.737159+0000","last_clean":"2023-03-06T13:49:13.737159+0000","last_became_active":"2023-03-06T13:49:13.728168+0000","last_became_peered":"2023-03-06T13:49:13.728168+0000","last_unstale":"2023-03-06T13:49:13.737159+0000","last_undegraded":"2023-03-06T13:49:13.737159+0000","last_fullsized":"2023-03-06T13:49:13.737159+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T18:43:12.631018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:13.734927+0000","last_change":"2023-03-06T13:49:13.730062+0000","last_active":"2023-03-06T13:49:13.734927+0000","last_peered":"2023-03-06T13:49:13.734927+0000","last_clean":"2023-03-06T13:49:13.734927+0000","last_became_active":"2023-03-06T13:49:13.729782+0000","last_became_peered":"2023-03-06T13:49:13.729782+0000","last_unstale":"2023-03-06T13:49:13.734927+0000","last_undegraded":"2023-03-06T13:49:13.734927+0000","last_fullsized":"2023-03-06T13:49:13.734927+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-08T01:30:43.884806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:13.730194+0000","last_change":"2023-03-06T13:49:13.725113+0000","last_active":"2023-03-06T13:49:13.730194+0000","last_peered":"2023-03-06T13:49:13.730194+0000","last_clean":"2023-03-06T13:49:13.730194+0000","last_became_active":"2023-03-06T13:49:13.724824+0000","last_became_peered":"2023-03-06T13:49:13.724824+0000","last_unstale":"2023-03-06T13:49:13.730194+0000","last_undegraded":"2023-03-06T13:49:13.730194+0000","last_fullsized":"2023-03-06T13:49:13.730194+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T20:18:58.498628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-06T13:49:14.714309+0000","last_change":"2023-03-06T13:49:13.724393+0000","last_active":"2023-03-06T13:49:14.714309+0000","last_peered":"2023-03-06T13:49:14.714309+0000","last_clean":"2023-03-06T13:49:14.714309+0000","last_became_active":"2023-03-06T13:49:13.724134+0000","last_became_peered":"2023-03-06T13:49:13.724134+0000","last_unstale":"2023-03-06T13:49:14.714309+0000","last_undegraded":"2023-03-06T13:49:14.714309+0000","last_fullsized":"2023-03-06T13:49:14.714309+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T23:04:29.575987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2330,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9096,"kb_used_data":832,"kb_used_omap":0,"kb_used_meta":8256,"kb_avail":94362744,"statfs":{"total":96636764160,"available":96627449856,"internally_reserved":0,"allocated":851968,"data_stored":675078,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8454144},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51100000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56899999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.501}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54300000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34999999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39800000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42199999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7976,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":7744,"kb_avail":94363864,"statfs":{"total":96636764160,"available":96628596736,"internally_reserved":0,"allocated":229376,"data_stored":82946,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7929856},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58299999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56499999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59599999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.625}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68100000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61199999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63700000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7976,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":7744,"kb_avail":94363864,"statfs":{"total":96636764160,"available":96628596736,"internally_reserved":0,"allocated":229376,"data_stored":82946,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7929856},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27700000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32300000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30499999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58099999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54300000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57099999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56299999999999994}]}]},{"osd":0,"up_from":13,"seq":55834574852,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9072,"kb_used_data":808,"kb_used_omap":0,"kb_used_meta":8256,"kb_avail":94362768,"statfs":{"total":96636764160,"available":96627474432,"internally_reserved":0,"allocated":827392,"data_stored":673880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8454144},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27900000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.316}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41999999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.503}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52500000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54000000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57899999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7912,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":7680,"kb_avail":94363928,"statfs":{"total":96636764160,"available":96628662272,"internally_reserved":0,"allocated":229376,"data_stored":82946,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7864320},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32400000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35199999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26200000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46700000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.432}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.504}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53200000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8044,"kb_used_data":228,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363796,"statfs":{"total":96636764160,"available":96628527104,"internally_reserved":0,"allocated":233472,"data_stored":83036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.376}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39300000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45800000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65600000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58699999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70399999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69199999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8060,"kb_used_data":244,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363780,"statfs":{"total":96636764160,"available":96628510720,"internally_reserved":0,"allocated":249856,"data_stored":84550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39800000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.374}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52100000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36099999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32400000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54900000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48099999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7984,"kb_used_data":232,"kb_used_omap":0,"kb_used_meta":7744,"kb_avail":94363856,"statfs":{"total":96636764160,"available":96628588544,"internally_reserved":0,"allocated":237568,"data_stored":83582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7929856},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33700000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41699999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45300000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.437}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36499999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52700000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47499999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-03-06T13:49:17.787 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-03-06T13:49:17.938 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.936+0000 7f08be131700 1 Processor -- start 2023-03-06T13:49:17.940 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.936+0000 7f08be131700 1 -- start start 2023-03-06T13:49:17.945 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.937+0000 7f08be131700 1 --2- >> v2:172.21.15.202:3300/0 conn(0x7f08b81496a0 0x7f08b8153270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:17.945 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.937+0000 7f08be131700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08b8152820 con 0x7f08b80c3940 2023-03-06T13:49:17.946 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.937+0000 7f08be131700 1 -- --> v1:172.21.15.202:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08b8152de0 con 0x7f08b814f230 2023-03-06T13:49:17.946 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.937+0000 7f08be131700 1 -- --> v2:172.21.15.202:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08b806ff30 con 0x7f08b81496a0 2023-03-06T13:49:17.946 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.937+0000 7f08b7fff700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f08b80c3940 0x7f08b8159bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:48814/0 (socket says 172.21.15.86:48814) 2023-03-06T13:49:17.946 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.937+0000 7f08b7fff700 1 -- 172.21.15.86:0/3571841 learned_addr learned my addr 172.21.15.86:0/3571841 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-03-06T13:49:17.946 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.937+0000 7f08b67fc700 1 -- 172.21.15.86:0/3571841 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1492616336 0 0) 0x7f08b8152820 con 0x7f08b80c3940 2023-03-06T13:49:17.946 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.937+0000 7f08b67fc700 1 -- 172.21.15.86:0/3571841 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f08a00035b0 con 0x7f08b80c3940 2023-03-06T13:49:17.947 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.937+0000 7f08b77fe700 1 --2- 172.21.15.86:0/3571841 >> v2:172.21.15.202:3300/0 conn(0x7f08b81496a0 0x7f08b8153270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:17.947 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.938+0000 7f08b67fc700 1 -- 172.21.15.86:0/3571841 <== mon.0 v1:172.21.15.86:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1953078752 0 0) 0x7f08a00035b0 con 0x7f08b80c3940 2023-03-06T13:49:17.947 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.938+0000 7f08b67fc700 1 -- 172.21.15.86:0/3571841 >> v2:172.21.15.202:3300/0 conn(0x7f08b81496a0 msgr2=0x7f08b8153270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T13:49:17.947 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.938+0000 7f08b67fc700 1 --2- 172.21.15.86:0/3571841 >> v2:172.21.15.202:3300/0 conn(0x7f08b81496a0 0x7f08b8153270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:17.947 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.938+0000 7f08b67fc700 1 -- 172.21.15.86:0/3571841 >> v1:172.21.15.202:6789/0 conn(0x7f08b814f230 legacy=0x7f08b806bb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:17.947 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.938+0000 7f08b67fc700 1 -- 172.21.15.86:0/3571841 --> v1:172.21.15.86:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08b81537b0 con 0x7f08b80c3940 2023-03-06T13:49:17.947 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.938+0000 7f08b67fc700 1 -- 172.21.15.86:0/3571841 <== mon.0 v1:172.21.15.86:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2191261126 0 0) 0x7f08b00019f0 con 0x7f08b80c3940 2023-03-06T13:49:17.947 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.938+0000 7f08b67fc700 1 -- 172.21.15.86:0/3571841 >> v1:172.21.15.86:6789/0 conn(0x7f08b80c3940 legacy=0x7f08b8159bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:17.948 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.938+0000 7f08b67fc700 1 --2- 172.21.15.86:0/3571841 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f08a0003a70 0x7f08a0003e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:17.948 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.938+0000 7f08b67fc700 1 --2- 172.21.15.86:0/3571841 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f08a0004850 0x7f08a0004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:17.948 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.938+0000 7f08b67fc700 1 --2- 172.21.15.86:0/3571841 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f08a0005320 0x7f08a000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:17.948 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.938+0000 7f08b67fc700 1 -- 172.21.15.86:0/3571841 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08a000c200 con 0x7f08a0004850 2023-03-06T13:49:17.948 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.938+0000 7f08b67fc700 1 -- 172.21.15.86:0/3571841 --> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08a000c370 con 0x7f08a0003a70 2023-03-06T13:49:17.948 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.938+0000 7f08b67fc700 1 -- 172.21.15.86:0/3571841 --> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08a000c530 con 0x7f08a0005320 2023-03-06T13:49:17.948 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.938+0000 7f08b6ffd700 1 --2- 172.21.15.86:0/3571841 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f08a0004850 0x7f08a0004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:17.948 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.938+0000 7f08b77fe700 1 --2- 172.21.15.86:0/3571841 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f08a0003a70 0x7f08a0003e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:17.949 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.938+0000 7f08b7fff700 1 --2- 172.21.15.86:0/3571841 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f08a0005320 0x7f08a000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:17.949 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.938+0000 7f08b6ffd700 1 -- 172.21.15.86:0/3571841 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f08a0005320 msgr2=0x7f08a000ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T13:49:17.949 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.938+0000 7f08b6ffd700 1 --2- 172.21.15.86:0/3571841 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f08a0005320 0x7f08a000ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:17.949 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.938+0000 7f08b6ffd700 1 -- 172.21.15.86:0/3571841 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f08a0003a70 msgr2=0x7f08a0003e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T13:49:17.949 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.938+0000 7f08b6ffd700 1 --2- 172.21.15.86:0/3571841 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f08a0003a70 0x7f08a0003e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:17.949 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.938+0000 7f08b6ffd700 1 -- 172.21.15.86:0/3571841 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08a00035b0 con 0x7f08a0004850 2023-03-06T13:49:17.949 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.938+0000 7f08b7fff700 1 --2- 172.21.15.86:0/3571841 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f08a0005320 0x7f08a000ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-06T13:49:17.950 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.938+0000 7f08b7fff700 1 -- 172.21.15.86:0/3571841 reap_dead start 2023-03-06T13:49:17.950 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.938+0000 7f08b6ffd700 1 --2- 172.21.15.86:0/3571841 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f08a0004850 0x7f08a0004cc0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f08a80017c0 tx=0x7f08a0005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23a7024ac47370e7 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T13:49:17.950 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.938+0000 7f08b67fc700 1 -- 172.21.15.86:0/3571841 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08a80052d0 con 0x7f08a0004850 2023-03-06T13:49:17.950 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.938+0000 7f08b67fc700 1 -- 172.21.15.86:0/3571841 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08a8005430 con 0x7f08a0004850 2023-03-06T13:49:17.950 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.938+0000 7f08b67fc700 1 -- 172.21.15.86:0/3571841 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08a80038c0 con 0x7f08a0004850 2023-03-06T13:49:17.950 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.939+0000 7f08be131700 1 -- 172.21.15.86:0/3571841 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f08a0004850 msgr2=0x7f08a0004cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:17.950 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.939+0000 7f08be131700 1 --2- 172.21.15.86:0/3571841 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f08a0004850 0x7f08a0004cc0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f08a80017c0 tx=0x7f08a0005880 comp rx=0 tx=0).stop 2023-03-06T13:49:17.951 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.939+0000 7f08be131700 1 -- 172.21.15.86:0/3571841 shutdown_connections 2023-03-06T13:49:17.951 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.939+0000 7f08be131700 1 --2- 172.21.15.86:0/3571841 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f08a0004850 0x7f08a0004cc0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:17.951 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.939+0000 7f08be131700 1 -- 172.21.15.86:0/3571841 >> 172.21.15.86:0/3571841 conn(0x7f08b806af80 msgr2=0x7f08b80c3230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T13:49:17.951 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.939+0000 7f08be131700 1 -- 172.21.15.86:0/3571841 shutdown_connections 2023-03-06T13:49:17.951 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.939+0000 7f08be131700 1 -- 172.21.15.86:0/3571841 wait complete. 2023-03-06T13:49:17.951 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.940+0000 7f08be131700 1 Processor -- start 2023-03-06T13:49:17.951 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.940+0000 7f08be131700 1 -- start start 2023-03-06T13:49:17.951 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.941+0000 7f08be131700 1 --2- >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f08a0004850 0x7f08b81daa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:17.952 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.941+0000 7f08be131700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f08b80be2a0 0x7f08b80b8e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:17.952 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.941+0000 7f08be131700 1 --2- >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f08b80a7910 0x7f08b80a6d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:17.952 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.941+0000 7f08be131700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08b81dafc0 con 0x7f08b80be2a0 2023-03-06T13:49:17.952 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.941+0000 7f08be131700 1 -- --> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08b80b9380 con 0x7f08b80a7910 2023-03-06T13:49:17.952 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.941+0000 7f08be131700 1 -- --> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08b80a7250 con 0x7f08a0004850 2023-03-06T13:49:17.952 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.941+0000 7f08b6ffd700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f08b80be2a0 0x7f08b80b8e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:17.952 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.941+0000 7f08b6ffd700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f08b80be2a0 0x7f08b80b8e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:38678/0 (socket says 172.21.15.86:38678) 2023-03-06T13:49:17.952 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.941+0000 7f08b6ffd700 1 -- 172.21.15.86:0/3298540251 learned_addr learned my addr 172.21.15.86:0/3298540251 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-03-06T13:49:17.953 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.941+0000 7f08b77fe700 1 --2- 172.21.15.86:0/3298540251 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f08a0004850 0x7f08b81daa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:17.953 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.941+0000 7f08b7fff700 1 --2- 172.21.15.86:0/3298540251 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f08b80a7910 0x7f08b80a6d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:17.953 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.941+0000 7f08b6ffd700 1 -- 172.21.15.86:0/3298540251 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f08a0004850 msgr2=0x7f08b81daa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:17.953 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.941+0000 7f08b6ffd700 1 --2- 172.21.15.86:0/3298540251 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f08a0004850 0x7f08b81daa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:17.953 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.941+0000 7f08b6ffd700 1 -- 172.21.15.86:0/3298540251 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f08b80a7910 msgr2=0x7f08b80a6d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:17.953 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.941+0000 7f08b6ffd700 1 --2- 172.21.15.86:0/3298540251 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f08b80a7910 0x7f08b80a6d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:17.953 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.941+0000 7f08b6ffd700 1 -- 172.21.15.86:0/3298540251 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08b8152a70 con 0x7f08b80be2a0 2023-03-06T13:49:17.954 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.941+0000 7f08b77fe700 1 --2- 172.21.15.86:0/3298540251 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f08a0004850 0x7f08b81daa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-06T13:49:17.954 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.941+0000 7f08b6ffd700 1 --2- 172.21.15.86:0/3298540251 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f08b80be2a0 0x7f08b80b8e40 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f08a000c340 tx=0x7f08a8001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T13:49:17.954 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.942+0000 7f089ffff700 1 -- 172.21.15.86:0/3298540251 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08a8001290 con 0x7f08b80be2a0 2023-03-06T13:49:17.954 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.942+0000 7f089ffff700 1 -- 172.21.15.86:0/3298540251 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08a801d480 con 0x7f08b80be2a0 2023-03-06T13:49:17.954 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.942+0000 7f08be131700 1 -- 172.21.15.86:0/3298540251 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08b80bf720 con 0x7f08b80be2a0 2023-03-06T13:49:17.954 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.942+0000 7f089ffff700 1 -- 172.21.15.86:0/3298540251 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08a801d830 con 0x7f08b80be2a0 2023-03-06T13:49:17.954 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.942+0000 7f08be131700 1 -- 172.21.15.86:0/3298540251 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08b806f730 con 0x7f08b80be2a0 2023-03-06T13:49:17.954 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.943+0000 7f08be131700 1 -- 172.21.15.86:0/3298540251 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08b804e750 con 0x7f08b80be2a0 2023-03-06T13:49:17.955 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.943+0000 7f089ffff700 1 -- 172.21.15.86:0/3298540251 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f08a802f070 con 0x7f08b80be2a0 2023-03-06T13:49:17.955 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.943+0000 7f089ffff700 1 --2- 172.21.15.86:0/3298540251 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7f08a4068320 0x7f08a406a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:17.955 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.944+0000 7f089ffff700 1 -- 172.21.15.86:0/3298540251 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f08a8086970 con 0x7f08b80be2a0 2023-03-06T13:49:17.955 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.944+0000 7f08b77fe700 1 --2- 172.21.15.86:0/3298540251 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7f08a4068320 0x7f08a406a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:17.956 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.944+0000 7f08b77fe700 1 --2- 172.21.15.86:0/3298540251 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7f08a4068320 0x7f08a406a7d0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f08ac009ce0 tx=0x7f08ac008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T13:49:17.956 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:17.948+0000 7f089ffff700 1 -- 172.21.15.86:0/3298540251 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f08a80531d0 con 0x7f08b80be2a0 2023-03-06T13:49:18.129 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:18.127+0000 7f08be131700 1 -- 172.21.15.86:0/3298540251 --> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f08b81dafc0 con 0x7f08a4068320 2023-03-06T13:49:18.137 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:18.135+0000 7f089ffff700 1 -- 172.21.15.86:0/3298540251 <== mgr.4101 v2:172.21.15.86:6832/96468 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286638 (secure 0 0 0) 0x7f08b81dafc0 con 0x7f08a4068320 2023-03-06T13:49:18.141 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-03-06T13:49:18.143 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:18.138+0000 7f08be131700 1 -- 172.21.15.86:0/3298540251 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7f08a4068320 msgr2=0x7f08a406a7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:18.143 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:18.138+0000 7f08be131700 1 --2- 172.21.15.86:0/3298540251 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7f08a4068320 0x7f08a406a7d0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f08ac009ce0 tx=0x7f08ac008040 comp rx=0 tx=0).stop 2023-03-06T13:49:18.143 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:18.138+0000 7f08be131700 1 -- 172.21.15.86:0/3298540251 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f08b80be2a0 msgr2=0x7f08b80b8e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:18.143 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:18.138+0000 7f08be131700 1 --2- 172.21.15.86:0/3298540251 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f08b80be2a0 0x7f08b80b8e40 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f08a000c340 tx=0x7f08a8001120 comp rx=0 tx=0).stop 2023-03-06T13:49:18.143 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:18.138+0000 7f08be131700 1 -- 172.21.15.86:0/3298540251 shutdown_connections 2023-03-06T13:49:18.144 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:18.138+0000 7f08be131700 1 --2- 172.21.15.86:0/3298540251 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7f08a4068320 0x7f08a406a7d0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:18.144 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:18.138+0000 7f08be131700 1 --2- 172.21.15.86:0/3298540251 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f08b80a7910 0x7f08b80a6d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:18.144 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:18.138+0000 7f08be131700 1 --2- 172.21.15.86:0/3298540251 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f08a0004850 0x7f08b81daa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:18.144 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:18.138+0000 7f08be131700 1 --2- 172.21.15.86:0/3298540251 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f08b80be2a0 0x7f08b80b8e40 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:18.144 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:18.138+0000 7f08be131700 1 -- 172.21.15.86:0/3298540251 >> 172.21.15.86:0/3298540251 conn(0x7f08b806af80 msgr2=0x7f08b8147130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T13:49:18.144 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:18.138+0000 7f08be131700 1 -- 172.21.15.86:0/3298540251 shutdown_connections 2023-03-06T13:49:18.144 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:18.138+0000 7f08be131700 1 -- 172.21.15.86:0/3298540251 wait complete. 2023-03-06T13:49:18.145 INFO:teuthology.orchestra.run.smithi086.stderr:dumped all 2023-03-06T13:49:18.151 INFO:teuthology.orchestra.run.smithi086.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-03-06T13:49:17.837150+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592698,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":114,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":66120,"kb_used_data":3016,"kb_used_omap":0,"kb_used_meta":63040,"kb_avail":754908600,"statfs":{"total":773094113280,"available":773026406400,"internally_reserved":0,"allocated":3088384,"data_stored":1848964,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":64552960},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2330,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.528022"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:13.730957+0000","last_change":"2023-03-06T13:49:13.726873+0000","last_active":"2023-03-06T13:49:13.730957+0000","last_peered":"2023-03-06T13:49:13.730957+0000","last_clean":"2023-03-06T13:49:13.730957+0000","last_became_active":"2023-03-06T13:49:13.726628+0000","last_became_peered":"2023-03-06T13:49:13.726628+0000","last_unstale":"2023-03-06T13:49:13.730957+0000","last_undegraded":"2023-03-06T13:49:13.730957+0000","last_fullsized":"2023-03-06T13:49:13.730957+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T19:17:36.354708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:13.728236+0000","last_change":"2023-03-06T13:49:13.721134+0000","last_active":"2023-03-06T13:49:13.728236+0000","last_peered":"2023-03-06T13:49:13.728236+0000","last_clean":"2023-03-06T13:49:13.728236+0000","last_became_active":"2023-03-06T13:49:13.720869+0000","last_became_peered":"2023-03-06T13:49:13.720869+0000","last_unstale":"2023-03-06T13:49:13.728236+0000","last_undegraded":"2023-03-06T13:49:13.728236+0000","last_fullsized":"2023-03-06T13:49:13.728236+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T16:46:29.744316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:13.734262+0000","last_change":"2023-03-06T13:49:13.729489+0000","last_active":"2023-03-06T13:49:13.734262+0000","last_peered":"2023-03-06T13:49:13.734262+0000","last_clean":"2023-03-06T13:49:13.734262+0000","last_became_active":"2023-03-06T13:49:13.729243+0000","last_became_peered":"2023-03-06T13:49:13.729243+0000","last_unstale":"2023-03-06T13:49:13.734262+0000","last_undegraded":"2023-03-06T13:49:13.734262+0000","last_fullsized":"2023-03-06T13:49:13.734262+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T19:08:52.672756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-06T13:49:14.715661+0000","last_change":"2023-03-06T13:49:13.726808+0000","last_active":"2023-03-06T13:49:14.715661+0000","last_peered":"2023-03-06T13:49:14.715661+0000","last_clean":"2023-03-06T13:49:14.715661+0000","last_became_active":"2023-03-06T13:49:13.726503+0000","last_became_peered":"2023-03-06T13:49:13.726503+0000","last_unstale":"2023-03-06T13:49:14.715661+0000","last_undegraded":"2023-03-06T13:49:14.715661+0000","last_fullsized":"2023-03-06T13:49:14.715661+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T18:44:55.549229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:13.729675+0000","last_change":"2023-03-06T13:49:13.725773+0000","last_active":"2023-03-06T13:49:13.729675+0000","last_peered":"2023-03-06T13:49:13.729675+0000","last_clean":"2023-03-06T13:49:13.729675+0000","last_became_active":"2023-03-06T13:49:13.725564+0000","last_became_peered":"2023-03-06T13:49:13.725564+0000","last_unstale":"2023-03-06T13:49:13.729675+0000","last_undegraded":"2023-03-06T13:49:13.729675+0000","last_fullsized":"2023-03-06T13:49:13.729675+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T20:18:58.498628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:13.734908+0000","last_change":"2023-03-06T13:49:13.729753+0000","last_active":"2023-03-06T13:49:13.734908+0000","last_peered":"2023-03-06T13:49:13.734908+0000","last_clean":"2023-03-06T13:49:13.734908+0000","last_became_active":"2023-03-06T13:49:13.729417+0000","last_became_peered":"2023-03-06T13:49:13.729417+0000","last_unstale":"2023-03-06T13:49:13.734908+0000","last_undegraded":"2023-03-06T13:49:13.734908+0000","last_fullsized":"2023-03-06T13:49:13.734908+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T18:31:22.344849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:13.734937+0000","last_change":"2023-03-06T13:49:13.732669+0000","last_active":"2023-03-06T13:49:13.734937+0000","last_peered":"2023-03-06T13:49:13.734937+0000","last_clean":"2023-03-06T13:49:13.734937+0000","last_became_active":"2023-03-06T13:49:13.732195+0000","last_became_peered":"2023-03-06T13:49:13.732195+0000","last_unstale":"2023-03-06T13:49:13.734937+0000","last_undegraded":"2023-03-06T13:49:13.734937+0000","last_fullsized":"2023-03-06T13:49:13.734937+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T19:41:30.016073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:13.733212+0000","last_change":"2023-03-06T13:49:13.731729+0000","last_active":"2023-03-06T13:49:13.733212+0000","last_peered":"2023-03-06T13:49:13.733212+0000","last_clean":"2023-03-06T13:49:13.733212+0000","last_became_active":"2023-03-06T13:49:13.731424+0000","last_became_peered":"2023-03-06T13:49:13.731424+0000","last_unstale":"2023-03-06T13:49:13.733212+0000","last_undegraded":"2023-03-06T13:49:13.733212+0000","last_fullsized":"2023-03-06T13:49:13.733212+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T19:41:30.016073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:13.734989+0000","last_change":"2023-03-06T13:49:13.731091+0000","last_active":"2023-03-06T13:49:13.734989+0000","last_peered":"2023-03-06T13:49:13.734989+0000","last_clean":"2023-03-06T13:49:13.734989+0000","last_became_active":"2023-03-06T13:49:13.730858+0000","last_became_peered":"2023-03-06T13:49:13.730858+0000","last_unstale":"2023-03-06T13:49:13.734989+0000","last_undegraded":"2023-03-06T13:49:13.734989+0000","last_fullsized":"2023-03-06T13:49:13.734989+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T17:11:13.619652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:13.731061+0000","last_change":"2023-03-06T13:49:13.726985+0000","last_active":"2023-03-06T13:49:13.731061+0000","last_peered":"2023-03-06T13:49:13.731061+0000","last_clean":"2023-03-06T13:49:13.731061+0000","last_became_active":"2023-03-06T13:49:13.726697+0000","last_became_peered":"2023-03-06T13:49:13.726697+0000","last_unstale":"2023-03-06T13:49:13.731061+0000","last_undegraded":"2023-03-06T13:49:13.731061+0000","last_fullsized":"2023-03-06T13:49:13.731061+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T22:37:42.599167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:13.736884+0000","last_change":"2023-03-06T13:49:13.735341+0000","last_active":"2023-03-06T13:49:13.736884+0000","last_peered":"2023-03-06T13:49:13.736884+0000","last_clean":"2023-03-06T13:49:13.736884+0000","last_became_active":"2023-03-06T13:49:13.733728+0000","last_became_peered":"2023-03-06T13:49:13.733728+0000","last_unstale":"2023-03-06T13:49:13.736884+0000","last_undegraded":"2023-03-06T13:49:13.736884+0000","last_fullsized":"2023-03-06T13:49:13.736884+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T14:31:12.427709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:13.736688+0000","last_change":"2023-03-06T13:49:13.733654+0000","last_active":"2023-03-06T13:49:13.736688+0000","last_peered":"2023-03-06T13:49:13.736688+0000","last_clean":"2023-03-06T13:49:13.736688+0000","last_became_active":"2023-03-06T13:49:13.733408+0000","last_became_peered":"2023-03-06T13:49:13.733408+0000","last_unstale":"2023-03-06T13:49:13.736688+0000","last_undegraded":"2023-03-06T13:49:13.736688+0000","last_fullsized":"2023-03-06T13:49:13.736688+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T20:23:18.245157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:13.730816+0000","last_change":"2023-03-06T13:49:13.726066+0000","last_active":"2023-03-06T13:49:13.730816+0000","last_peered":"2023-03-06T13:49:13.730816+0000","last_clean":"2023-03-06T13:49:13.730816+0000","last_became_active":"2023-03-06T13:49:13.725767+0000","last_became_peered":"2023-03-06T13:49:13.725767+0000","last_unstale":"2023-03-06T13:49:13.730816+0000","last_undegraded":"2023-03-06T13:49:13.730816+0000","last_fullsized":"2023-03-06T13:49:13.730816+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T16:21:45.003183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:13.728022+0000","last_change":"2023-03-06T13:49:13.721687+0000","last_active":"2023-03-06T13:49:13.728022+0000","last_peered":"2023-03-06T13:49:13.728022+0000","last_clean":"2023-03-06T13:49:13.728022+0000","last_became_active":"2023-03-06T13:49:13.721400+0000","last_became_peered":"2023-03-06T13:49:13.721400+0000","last_unstale":"2023-03-06T13:49:13.728022+0000","last_undegraded":"2023-03-06T13:49:13.728022+0000","last_fullsized":"2023-03-06T13:49:13.728022+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T15:06:01.435712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:13.734957+0000","last_change":"2023-03-06T13:49:13.733193+0000","last_active":"2023-03-06T13:49:13.734957+0000","last_peered":"2023-03-06T13:49:13.734957+0000","last_clean":"2023-03-06T13:49:13.734957+0000","last_became_active":"2023-03-06T13:49:13.732559+0000","last_became_peered":"2023-03-06T13:49:13.732559+0000","last_unstale":"2023-03-06T13:49:13.734957+0000","last_undegraded":"2023-03-06T13:49:13.734957+0000","last_fullsized":"2023-03-06T13:49:13.734957+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T15:06:01.435712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:13.734281+0000","last_change":"2023-03-06T13:49:13.730075+0000","last_active":"2023-03-06T13:49:13.734281+0000","last_peered":"2023-03-06T13:49:13.734281+0000","last_clean":"2023-03-06T13:49:13.734281+0000","last_became_active":"2023-03-06T13:49:13.729158+0000","last_became_peered":"2023-03-06T13:49:13.729158+0000","last_unstale":"2023-03-06T13:49:13.734281+0000","last_undegraded":"2023-03-06T13:49:13.734281+0000","last_fullsized":"2023-03-06T13:49:13.734281+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T19:41:30.016073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:13.734968+0000","last_change":"2023-03-06T13:49:13.731030+0000","last_active":"2023-03-06T13:49:13.734968+0000","last_peered":"2023-03-06T13:49:13.734968+0000","last_clean":"2023-03-06T13:49:13.734968+0000","last_became_active":"2023-03-06T13:49:13.730786+0000","last_became_peered":"2023-03-06T13:49:13.730786+0000","last_unstale":"2023-03-06T13:49:13.734968+0000","last_undegraded":"2023-03-06T13:49:13.734968+0000","last_fullsized":"2023-03-06T13:49:13.734968+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T16:42:39.878112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:13.733980+0000","last_change":"2023-03-06T13:49:13.728942+0000","last_active":"2023-03-06T13:49:13.733980+0000","last_peered":"2023-03-06T13:49:13.733980+0000","last_clean":"2023-03-06T13:49:13.733980+0000","last_became_active":"2023-03-06T13:49:13.727975+0000","last_became_peered":"2023-03-06T13:49:13.727975+0000","last_unstale":"2023-03-06T13:49:13.733980+0000","last_undegraded":"2023-03-06T13:49:13.733980+0000","last_fullsized":"2023-03-06T13:49:13.733980+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T22:37:42.599167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:13.725142+0000","last_change":"2023-03-06T13:49:13.721970+0000","last_active":"2023-03-06T13:49:13.725142+0000","last_peered":"2023-03-06T13:49:13.725142+0000","last_clean":"2023-03-06T13:49:13.725142+0000","last_became_active":"2023-03-06T13:49:13.721722+0000","last_became_peered":"2023-03-06T13:49:13.721722+0000","last_unstale":"2023-03-06T13:49:13.725142+0000","last_undegraded":"2023-03-06T13:49:13.725142+0000","last_fullsized":"2023-03-06T13:49:13.725142+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T19:53:35.686308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:13.735777+0000","last_change":"2023-03-06T13:49:13.732576+0000","last_active":"2023-03-06T13:49:13.735777+0000","last_peered":"2023-03-06T13:49:13.735777+0000","last_clean":"2023-03-06T13:49:13.735777+0000","last_became_active":"2023-03-06T13:49:13.732314+0000","last_became_peered":"2023-03-06T13:49:13.732314+0000","last_unstale":"2023-03-06T13:49:13.735777+0000","last_undegraded":"2023-03-06T13:49:13.735777+0000","last_fullsized":"2023-03-06T13:49:13.735777+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T20:18:58.498628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:13.736769+0000","last_change":"2023-03-06T13:49:13.734115+0000","last_active":"2023-03-06T13:49:13.736769+0000","last_peered":"2023-03-06T13:49:13.736769+0000","last_clean":"2023-03-06T13:49:13.736769+0000","last_became_active":"2023-03-06T13:49:13.733850+0000","last_became_peered":"2023-03-06T13:49:13.733850+0000","last_unstale":"2023-03-06T13:49:13.736769+0000","last_undegraded":"2023-03-06T13:49:13.736769+0000","last_fullsized":"2023-03-06T13:49:13.736769+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T16:46:29.744316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:13.729726+0000","last_change":"2023-03-06T13:49:13.724411+0000","last_active":"2023-03-06T13:49:13.729726+0000","last_peered":"2023-03-06T13:49:13.729726+0000","last_clean":"2023-03-06T13:49:13.729726+0000","last_became_active":"2023-03-06T13:49:13.724151+0000","last_became_peered":"2023-03-06T13:49:13.724151+0000","last_unstale":"2023-03-06T13:49:13.729726+0000","last_undegraded":"2023-03-06T13:49:13.729726+0000","last_fullsized":"2023-03-06T13:49:13.729726+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T19:41:30.016073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:13.734183+0000","last_change":"2023-03-06T13:49:13.727285+0000","last_active":"2023-03-06T13:49:13.734183+0000","last_peered":"2023-03-06T13:49:13.734183+0000","last_clean":"2023-03-06T13:49:13.734183+0000","last_became_active":"2023-03-06T13:49:13.724921+0000","last_became_peered":"2023-03-06T13:49:13.724921+0000","last_unstale":"2023-03-06T13:49:13.734183+0000","last_undegraded":"2023-03-06T13:49:13.734183+0000","last_fullsized":"2023-03-06T13:49:13.734183+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-08T00:56:55.731171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:13.736634+0000","last_change":"2023-03-06T13:49:13.732435+0000","last_active":"2023-03-06T13:49:13.736634+0000","last_peered":"2023-03-06T13:49:13.736634+0000","last_clean":"2023-03-06T13:49:13.736634+0000","last_became_active":"2023-03-06T13:49:13.732118+0000","last_became_peered":"2023-03-06T13:49:13.732118+0000","last_unstale":"2023-03-06T13:49:13.736634+0000","last_undegraded":"2023-03-06T13:49:13.736634+0000","last_fullsized":"2023-03-06T13:49:13.736634+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T22:37:42.599167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-06T13:49:14.714294+0000","last_change":"2023-03-06T13:49:13.722347+0000","last_active":"2023-03-06T13:49:14.714294+0000","last_peered":"2023-03-06T13:49:14.714294+0000","last_clean":"2023-03-06T13:49:14.714294+0000","last_became_active":"2023-03-06T13:49:13.722089+0000","last_became_peered":"2023-03-06T13:49:13.722089+0000","last_unstale":"2023-03-06T13:49:14.714294+0000","last_undegraded":"2023-03-06T13:49:14.714294+0000","last_fullsized":"2023-03-06T13:49:14.714294+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T18:20:43.874725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-06T13:49:14.714475+0000","last_change":"2023-03-06T13:49:13.721459+0000","last_active":"2023-03-06T13:49:14.714475+0000","last_peered":"2023-03-06T13:49:14.714475+0000","last_clean":"2023-03-06T13:49:14.714475+0000","last_became_active":"2023-03-06T13:49:13.721210+0000","last_became_peered":"2023-03-06T13:49:13.721210+0000","last_unstale":"2023-03-06T13:49:14.714475+0000","last_undegraded":"2023-03-06T13:49:14.714475+0000","last_fullsized":"2023-03-06T13:49:14.714475+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T21:46:16.457828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:13.734332+0000","last_change":"2023-03-06T13:49:13.729761+0000","last_active":"2023-03-06T13:49:13.734332+0000","last_peered":"2023-03-06T13:49:13.734332+0000","last_clean":"2023-03-06T13:49:13.734332+0000","last_became_active":"2023-03-06T13:49:13.729301+0000","last_became_peered":"2023-03-06T13:49:13.729301+0000","last_unstale":"2023-03-06T13:49:13.734332+0000","last_undegraded":"2023-03-06T13:49:13.734332+0000","last_fullsized":"2023-03-06T13:49:13.734332+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T16:42:39.878112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"22'1","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:13.734834+0000","last_change":"2023-03-06T13:49:13.328562+0000","last_active":"2023-03-06T13:49:13.734834+0000","last_peered":"2023-03-06T13:49:13.734834+0000","last_clean":"2023-03-06T13:49:13.734834+0000","last_became_active":"2023-03-06T13:49:13.328314+0000","last_became_peered":"2023-03-06T13:49:13.328314+0000","last_unstale":"2023-03-06T13:49:13.734834+0000","last_undegraded":"2023-03-06T13:49:13.734834+0000","last_fullsized":"2023-03-06T13:49:13.734834+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_clean_scrub_stamp":"2023-03-06T13:49:12.303785+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-08T00:39:06.477914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:13.737345+0000","last_change":"2023-03-06T13:49:13.729956+0000","last_active":"2023-03-06T13:49:13.737345+0000","last_peered":"2023-03-06T13:49:13.737345+0000","last_clean":"2023-03-06T13:49:13.737345+0000","last_became_active":"2023-03-06T13:49:13.728115+0000","last_became_peered":"2023-03-06T13:49:13.728115+0000","last_unstale":"2023-03-06T13:49:13.737345+0000","last_undegraded":"2023-03-06T13:49:13.737345+0000","last_fullsized":"2023-03-06T13:49:13.737345+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T22:37:42.599167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-06T13:49:14.714081+0000","last_change":"2023-03-06T13:49:13.330148+0000","last_active":"2023-03-06T13:49:14.714081+0000","last_peered":"2023-03-06T13:49:14.714081+0000","last_clean":"2023-03-06T13:49:14.714081+0000","last_became_active":"2023-03-06T13:49:13.329874+0000","last_became_peered":"2023-03-06T13:49:13.329874+0000","last_unstale":"2023-03-06T13:49:14.714081+0000","last_undegraded":"2023-03-06T13:49:14.714081+0000","last_fullsized":"2023-03-06T13:49:14.714081+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_clean_scrub_stamp":"2023-03-06T13:49:12.303785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T14:43:51.863266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:13.730149+0000","last_change":"2023-03-06T13:49:13.726403+0000","last_active":"2023-03-06T13:49:13.730149+0000","last_peered":"2023-03-06T13:49:13.730149+0000","last_clean":"2023-03-06T13:49:13.730149+0000","last_became_active":"2023-03-06T13:49:13.726155+0000","last_became_peered":"2023-03-06T13:49:13.726155+0000","last_unstale":"2023-03-06T13:49:13.730149+0000","last_undegraded":"2023-03-06T13:49:13.730149+0000","last_fullsized":"2023-03-06T13:49:13.730149+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T18:43:12.631018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:13.713363+0000","last_change":"2023-03-06T13:49:13.333031+0000","last_active":"2023-03-06T13:49:13.713363+0000","last_peered":"2023-03-06T13:49:13.713363+0000","last_clean":"2023-03-06T13:49:13.713363+0000","last_became_active":"2023-03-06T13:49:13.332715+0000","last_became_peered":"2023-03-06T13:49:13.332715+0000","last_unstale":"2023-03-06T13:49:13.713363+0000","last_undegraded":"2023-03-06T13:49:13.713363+0000","last_fullsized":"2023-03-06T13:49:13.713363+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_clean_scrub_stamp":"2023-03-06T13:49:12.303785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T20:52:58.439733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-06T13:49:14.716097+0000","last_change":"2023-03-06T13:49:13.729931+0000","last_active":"2023-03-06T13:49:14.716097+0000","last_peered":"2023-03-06T13:49:14.716097+0000","last_clean":"2023-03-06T13:49:14.716097+0000","last_became_active":"2023-03-06T13:49:13.729657+0000","last_became_peered":"2023-03-06T13:49:13.729657+0000","last_unstale":"2023-03-06T13:49:14.716097+0000","last_undegraded":"2023-03-06T13:49:14.716097+0000","last_fullsized":"2023-03-06T13:49:14.716097+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T23:59:53.012700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:13.718171+0000","last_change":"2023-03-06T13:49:13.335979+0000","last_active":"2023-03-06T13:49:13.718171+0000","last_peered":"2023-03-06T13:49:13.718171+0000","last_clean":"2023-03-06T13:49:13.718171+0000","last_became_active":"2023-03-06T13:49:13.335701+0000","last_became_peered":"2023-03-06T13:49:13.335701+0000","last_unstale":"2023-03-06T13:49:13.718171+0000","last_undegraded":"2023-03-06T13:49:13.718171+0000","last_fullsized":"2023-03-06T13:49:13.718171+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_clean_scrub_stamp":"2023-03-06T13:49:12.303785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T19:17:35.350354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:13.727522+0000","last_change":"2023-03-06T13:49:13.721193+0000","last_active":"2023-03-06T13:49:13.727522+0000","last_peered":"2023-03-06T13:49:13.727522+0000","last_clean":"2023-03-06T13:49:13.727522+0000","last_became_active":"2023-03-06T13:49:13.720968+0000","last_became_peered":"2023-03-06T13:49:13.720968+0000","last_unstale":"2023-03-06T13:49:13.727522+0000","last_undegraded":"2023-03-06T13:49:13.727522+0000","last_fullsized":"2023-03-06T13:49:13.727522+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T16:42:39.878112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:13.714568+0000","last_change":"2023-03-06T13:49:13.336210+0000","last_active":"2023-03-06T13:49:13.714568+0000","last_peered":"2023-03-06T13:49:13.714568+0000","last_clean":"2023-03-06T13:49:13.714568+0000","last_became_active":"2023-03-06T13:49:13.335895+0000","last_became_peered":"2023-03-06T13:49:13.335895+0000","last_unstale":"2023-03-06T13:49:13.714568+0000","last_undegraded":"2023-03-06T13:49:13.714568+0000","last_fullsized":"2023-03-06T13:49:13.714568+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_clean_scrub_stamp":"2023-03-06T13:49:12.303785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T19:53:34.681954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:13.734203+0000","last_change":"2023-03-06T13:49:13.727461+0000","last_active":"2023-03-06T13:49:13.734203+0000","last_peered":"2023-03-06T13:49:13.734203+0000","last_clean":"2023-03-06T13:49:13.734203+0000","last_became_active":"2023-03-06T13:49:13.726691+0000","last_became_peered":"2023-03-06T13:49:13.726691+0000","last_unstale":"2023-03-06T13:49:13.734203+0000","last_undegraded":"2023-03-06T13:49:13.734203+0000","last_fullsized":"2023-03-06T13:49:13.734203+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-08T01:30:43.884806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"22'3","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:13.740193+0000","last_change":"2023-03-06T13:49:13.337258+0000","last_active":"2023-03-06T13:49:13.740193+0000","last_peered":"2023-03-06T13:49:13.740193+0000","last_clean":"2023-03-06T13:49:13.740193+0000","last_became_active":"2023-03-06T13:49:13.336956+0000","last_became_peered":"2023-03-06T13:49:13.336956+0000","last_unstale":"2023-03-06T13:49:13.740193+0000","last_undegraded":"2023-03-06T13:49:13.740193+0000","last_fullsized":"2023-03-06T13:49:13.740193+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_clean_scrub_stamp":"2023-03-06T13:49:12.303785+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T20:23:17.240803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-06T13:49:14.714418+0000","last_change":"2023-03-06T13:49:13.720024+0000","last_active":"2023-03-06T13:49:14.714418+0000","last_peered":"2023-03-06T13:49:14.714418+0000","last_clean":"2023-03-06T13:49:14.714418+0000","last_became_active":"2023-03-06T13:49:13.719745+0000","last_became_peered":"2023-03-06T13:49:13.719745+0000","last_unstale":"2023-03-06T13:49:14.714418+0000","last_undegraded":"2023-03-06T13:49:14.714418+0000","last_fullsized":"2023-03-06T13:49:14.714418+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T20:22:12.811857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"22'6","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:13.739135+0000","last_change":"2023-03-06T13:49:13.332863+0000","last_active":"2023-03-06T13:49:13.739135+0000","last_peered":"2023-03-06T13:49:13.739135+0000","last_clean":"2023-03-06T13:49:13.739135+0000","last_became_active":"2023-03-06T13:49:13.332579+0000","last_became_peered":"2023-03-06T13:49:13.332579+0000","last_unstale":"2023-03-06T13:49:13.739135+0000","last_undegraded":"2023-03-06T13:49:13.739135+0000","last_fullsized":"2023-03-06T13:49:13.739135+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_clean_scrub_stamp":"2023-03-06T13:49:12.303785+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T18:49:50.763848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1548,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:13.734393+0000","last_change":"2023-03-06T13:49:13.728503+0000","last_active":"2023-03-06T13:49:13.734393+0000","last_peered":"2023-03-06T13:49:13.734393+0000","last_clean":"2023-03-06T13:49:13.734393+0000","last_became_active":"2023-03-06T13:49:13.727740+0000","last_became_peered":"2023-03-06T13:49:13.727740+0000","last_unstale":"2023-03-06T13:49:13.734393+0000","last_undegraded":"2023-03-06T13:49:13.734393+0000","last_fullsized":"2023-03-06T13:49:13.734393+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-08T00:56:55.731171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.13","version":"22'2","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:13.734859+0000","last_change":"2023-03-06T13:49:13.336773+0000","last_active":"2023-03-06T13:49:13.734859+0000","last_peered":"2023-03-06T13:49:13.734859+0000","last_clean":"2023-03-06T13:49:13.734859+0000","last_became_active":"2023-03-06T13:49:13.336321+0000","last_became_peered":"2023-03-06T13:49:13.336321+0000","last_unstale":"2023-03-06T13:49:13.734859+0000","last_undegraded":"2023-03-06T13:49:13.734859+0000","last_fullsized":"2023-03-06T13:49:13.734859+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_clean_scrub_stamp":"2023-03-06T13:49:12.303785+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-08T01:45:44.452690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:13.731667+0000","last_change":"2023-03-06T13:49:13.725662+0000","last_active":"2023-03-06T13:49:13.731667+0000","last_peered":"2023-03-06T13:49:13.731667+0000","last_clean":"2023-03-06T13:49:13.731667+0000","last_became_active":"2023-03-06T13:49:13.725029+0000","last_became_peered":"2023-03-06T13:49:13.725029+0000","last_unstale":"2023-03-06T13:49:13.731667+0000","last_undegraded":"2023-03-06T13:49:13.731667+0000","last_fullsized":"2023-03-06T13:49:13.731667+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T19:41:30.016073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:13.717059+0000","last_change":"2023-03-06T13:49:13.332902+0000","last_active":"2023-03-06T13:49:13.717059+0000","last_peered":"2023-03-06T13:49:13.717059+0000","last_clean":"2023-03-06T13:49:13.717059+0000","last_became_active":"2023-03-06T13:49:13.332641+0000","last_became_peered":"2023-03-06T13:49:13.332641+0000","last_unstale":"2023-03-06T13:49:13.717059+0000","last_undegraded":"2023-03-06T13:49:13.717059+0000","last_fullsized":"2023-03-06T13:49:13.717059+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_clean_scrub_stamp":"2023-03-06T13:49:12.303785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T19:26:48.272662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:13.734314+0000","last_change":"2023-03-06T13:49:13.729557+0000","last_active":"2023-03-06T13:49:13.734314+0000","last_peered":"2023-03-06T13:49:13.734314+0000","last_clean":"2023-03-06T13:49:13.734314+0000","last_became_active":"2023-03-06T13:49:13.728917+0000","last_became_peered":"2023-03-06T13:49:13.728917+0000","last_unstale":"2023-03-06T13:49:13.734314+0000","last_undegraded":"2023-03-06T13:49:13.734314+0000","last_fullsized":"2023-03-06T13:49:13.734314+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T18:43:12.631018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:13.717025+0000","last_change":"2023-03-06T13:49:13.337738+0000","last_active":"2023-03-06T13:49:13.717025+0000","last_peered":"2023-03-06T13:49:13.717025+0000","last_clean":"2023-03-06T13:49:13.717025+0000","last_became_active":"2023-03-06T13:49:13.337441+0000","last_became_peered":"2023-03-06T13:49:13.337441+0000","last_unstale":"2023-03-06T13:49:13.717025+0000","last_undegraded":"2023-03-06T13:49:13.717025+0000","last_fullsized":"2023-03-06T13:49:13.717025+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_clean_scrub_stamp":"2023-03-06T13:49:12.303785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T19:17:35.350354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:13.730131+0000","last_change":"2023-03-06T13:49:13.725893+0000","last_active":"2023-03-06T13:49:13.730131+0000","last_peered":"2023-03-06T13:49:13.730131+0000","last_clean":"2023-03-06T13:49:13.730131+0000","last_became_active":"2023-03-06T13:49:13.725632+0000","last_became_peered":"2023-03-06T13:49:13.725632+0000","last_unstale":"2023-03-06T13:49:13.730131+0000","last_undegraded":"2023-03-06T13:49:13.730131+0000","last_fullsized":"2023-03-06T13:49:13.730131+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-08T00:56:55.731171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"22'8","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-06T13:49:14.715336+0000","last_change":"2023-03-06T13:49:13.325572+0000","last_active":"2023-03-06T13:49:14.715336+0000","last_peered":"2023-03-06T13:49:14.715336+0000","last_clean":"2023-03-06T13:49:14.715336+0000","last_became_active":"2023-03-06T13:49:13.325252+0000","last_became_peered":"2023-03-06T13:49:13.325252+0000","last_unstale":"2023-03-06T13:49:14.715336+0000","last_undegraded":"2023-03-06T13:49:14.715336+0000","last_fullsized":"2023-03-06T13:49:14.715336+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_clean_scrub_stamp":"2023-03-06T13:49:12.303785+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T18:49:50.763848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:13.737083+0000","last_change":"2023-03-06T13:49:13.730932+0000","last_active":"2023-03-06T13:49:13.737083+0000","last_peered":"2023-03-06T13:49:13.737083+0000","last_clean":"2023-03-06T13:49:13.737083+0000","last_became_active":"2023-03-06T13:49:13.728504+0000","last_became_peered":"2023-03-06T13:49:13.728504+0000","last_unstale":"2023-03-06T13:49:13.737083+0000","last_undegraded":"2023-03-06T13:49:13.737083+0000","last_fullsized":"2023-03-06T13:49:13.737083+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T16:46:29.744316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"22'1","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:13.736956+0000","last_change":"2023-03-06T13:49:13.336765+0000","last_active":"2023-03-06T13:49:13.736956+0000","last_peered":"2023-03-06T13:49:13.736956+0000","last_clean":"2023-03-06T13:49:13.736956+0000","last_became_active":"2023-03-06T13:49:13.336364+0000","last_became_peered":"2023-03-06T13:49:13.336364+0000","last_unstale":"2023-03-06T13:49:13.736956+0000","last_undegraded":"2023-03-06T13:49:13.736956+0000","last_fullsized":"2023-03-06T13:49:13.736956+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_clean_scrub_stamp":"2023-03-06T13:49:12.303785+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T23:59:52.008346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:13.728159+0000","last_change":"2023-03-06T13:49:13.725154+0000","last_active":"2023-03-06T13:49:13.728159+0000","last_peered":"2023-03-06T13:49:13.728159+0000","last_clean":"2023-03-06T13:49:13.728159+0000","last_became_active":"2023-03-06T13:49:13.724853+0000","last_became_peered":"2023-03-06T13:49:13.724853+0000","last_unstale":"2023-03-06T13:49:13.728159+0000","last_undegraded":"2023-03-06T13:49:13.728159+0000","last_fullsized":"2023-03-06T13:49:13.728159+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T23:04:29.575987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"22'2","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:13.737334+0000","last_change":"2023-03-06T13:49:13.336914+0000","last_active":"2023-03-06T13:49:13.737334+0000","last_peered":"2023-03-06T13:49:13.737334+0000","last_clean":"2023-03-06T13:49:13.737334+0000","last_became_active":"2023-03-06T13:49:13.336552+0000","last_became_peered":"2023-03-06T13:49:13.336552+0000","last_unstale":"2023-03-06T13:49:13.737334+0000","last_undegraded":"2023-03-06T13:49:13.737334+0000","last_fullsized":"2023-03-06T13:49:13.737334+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_clean_scrub_stamp":"2023-03-06T13:49:12.303785+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T16:21:43.998829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:13.734089+0000","last_change":"2023-03-06T13:49:13.730794+0000","last_active":"2023-03-06T13:49:13.734089+0000","last_peered":"2023-03-06T13:49:13.734089+0000","last_clean":"2023-03-06T13:49:13.734089+0000","last_became_active":"2023-03-06T13:49:13.730504+0000","last_became_peered":"2023-03-06T13:49:13.730504+0000","last_unstale":"2023-03-06T13:49:13.734089+0000","last_undegraded":"2023-03-06T13:49:13.734089+0000","last_fullsized":"2023-03-06T13:49:13.734089+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T23:04:29.575987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"22'1","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:13.737342+0000","last_change":"2023-03-06T13:49:13.335019+0000","last_active":"2023-03-06T13:49:13.737342+0000","last_peered":"2023-03-06T13:49:13.737342+0000","last_clean":"2023-03-06T13:49:13.737342+0000","last_became_active":"2023-03-06T13:49:13.334748+0000","last_became_peered":"2023-03-06T13:49:13.334748+0000","last_unstale":"2023-03-06T13:49:13.737342+0000","last_undegraded":"2023-03-06T13:49:13.737342+0000","last_fullsized":"2023-03-06T13:49:13.737342+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_clean_scrub_stamp":"2023-03-06T13:49:12.303785+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T18:44:54.544875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-06T13:49:14.715551+0000","last_change":"2023-03-06T13:49:13.722448+0000","last_active":"2023-03-06T13:49:14.715551+0000","last_peered":"2023-03-06T13:49:14.715551+0000","last_clean":"2023-03-06T13:49:14.715551+0000","last_became_active":"2023-03-06T13:49:13.719433+0000","last_became_peered":"2023-03-06T13:49:13.719433+0000","last_unstale":"2023-03-06T13:49:14.715551+0000","last_undegraded":"2023-03-06T13:49:14.715551+0000","last_fullsized":"2023-03-06T13:49:14.715551+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T19:17:36.354708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:13.713511+0000","last_change":"2023-03-06T13:49:13.329213+0000","last_active":"2023-03-06T13:49:13.713511+0000","last_peered":"2023-03-06T13:49:13.713511+0000","last_clean":"2023-03-06T13:49:13.713511+0000","last_became_active":"2023-03-06T13:49:13.328881+0000","last_became_peered":"2023-03-06T13:49:13.328881+0000","last_unstale":"2023-03-06T13:49:13.713511+0000","last_undegraded":"2023-03-06T13:49:13.713511+0000","last_fullsized":"2023-03-06T13:49:13.713511+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_clean_scrub_stamp":"2023-03-06T13:49:12.303785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-08T01:45:44.452690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:13.728947+0000","last_change":"2023-03-06T13:49:13.722967+0000","last_active":"2023-03-06T13:49:13.728947+0000","last_peered":"2023-03-06T13:49:13.728947+0000","last_clean":"2023-03-06T13:49:13.728947+0000","last_became_active":"2023-03-06T13:49:13.722502+0000","last_became_peered":"2023-03-06T13:49:13.722502+0000","last_unstale":"2023-03-06T13:49:13.728947+0000","last_undegraded":"2023-03-06T13:49:13.728947+0000","last_fullsized":"2023-03-06T13:49:13.728947+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T16:46:29.744316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"22'2","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:13.730633+0000","last_change":"2023-03-06T13:49:13.334295+0000","last_active":"2023-03-06T13:49:13.730633+0000","last_peered":"2023-03-06T13:49:13.730633+0000","last_clean":"2023-03-06T13:49:13.730633+0000","last_became_active":"2023-03-06T13:49:13.334029+0000","last_became_peered":"2023-03-06T13:49:13.334029+0000","last_unstale":"2023-03-06T13:49:13.730633+0000","last_undegraded":"2023-03-06T13:49:13.730633+0000","last_fullsized":"2023-03-06T13:49:13.730633+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_clean_scrub_stamp":"2023-03-06T13:49:12.303785+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T17:43:02.141473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:13.737686+0000","last_change":"2023-03-06T13:49:13.735942+0000","last_active":"2023-03-06T13:49:13.737686+0000","last_peered":"2023-03-06T13:49:13.737686+0000","last_clean":"2023-03-06T13:49:13.737686+0000","last_became_active":"2023-03-06T13:49:13.735605+0000","last_became_peered":"2023-03-06T13:49:13.735605+0000","last_unstale":"2023-03-06T13:49:13.737686+0000","last_undegraded":"2023-03-06T13:49:13.737686+0000","last_fullsized":"2023-03-06T13:49:13.737686+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-08T01:35:08.480796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-06T13:49:14.715543+0000","last_change":"2023-03-06T13:49:13.334902+0000","last_active":"2023-03-06T13:49:14.715543+0000","last_peered":"2023-03-06T13:49:14.715543+0000","last_clean":"2023-03-06T13:49:14.715543+0000","last_became_active":"2023-03-06T13:49:13.334117+0000","last_became_peered":"2023-03-06T13:49:13.334117+0000","last_unstale":"2023-03-06T13:49:14.715543+0000","last_undegraded":"2023-03-06T13:49:14.715543+0000","last_fullsized":"2023-03-06T13:49:14.715543+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_clean_scrub_stamp":"2023-03-06T13:49:12.303785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T19:15:21.274175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:13.736904+0000","last_change":"2023-03-06T13:49:13.735438+0000","last_active":"2023-03-06T13:49:13.736904+0000","last_peered":"2023-03-06T13:49:13.736904+0000","last_clean":"2023-03-06T13:49:13.736904+0000","last_became_active":"2023-03-06T13:49:13.734124+0000","last_became_peered":"2023-03-06T13:49:13.734124+0000","last_unstale":"2023-03-06T13:49:13.736904+0000","last_undegraded":"2023-03-06T13:49:13.736904+0000","last_fullsized":"2023-03-06T13:49:13.736904+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T21:05:03.457340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:13.723257+0000","last_change":"2023-03-06T13:49:13.331505+0000","last_active":"2023-03-06T13:49:13.723257+0000","last_peered":"2023-03-06T13:49:13.723257+0000","last_clean":"2023-03-06T13:49:13.723257+0000","last_became_active":"2023-03-06T13:49:13.331213+0000","last_became_peered":"2023-03-06T13:49:13.331213+0000","last_unstale":"2023-03-06T13:49:13.723257+0000","last_undegraded":"2023-03-06T13:49:13.723257+0000","last_fullsized":"2023-03-06T13:49:13.723257+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_clean_scrub_stamp":"2023-03-06T13:49:12.303785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T14:43:51.863266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:13.734128+0000","last_change":"2023-03-06T13:49:13.731378+0000","last_active":"2023-03-06T13:49:13.734128+0000","last_peered":"2023-03-06T13:49:13.734128+0000","last_clean":"2023-03-06T13:49:13.734128+0000","last_became_active":"2023-03-06T13:49:13.729527+0000","last_became_peered":"2023-03-06T13:49:13.729527+0000","last_unstale":"2023-03-06T13:49:13.734128+0000","last_undegraded":"2023-03-06T13:49:13.734128+0000","last_fullsized":"2023-03-06T13:49:13.734128+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T17:11:13.619652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:13.713244+0000","last_change":"2023-03-06T13:49:13.333554+0000","last_active":"2023-03-06T13:49:13.713244+0000","last_peered":"2023-03-06T13:49:13.713244+0000","last_clean":"2023-03-06T13:49:13.713244+0000","last_became_active":"2023-03-06T13:49:13.333290+0000","last_became_peered":"2023-03-06T13:49:13.333290+0000","last_unstale":"2023-03-06T13:49:13.713244+0000","last_undegraded":"2023-03-06T13:49:13.713244+0000","last_fullsized":"2023-03-06T13:49:13.713244+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_clean_scrub_stamp":"2023-03-06T13:49:12.303785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T19:53:34.681954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-06T13:49:14.714385+0000","last_change":"2023-03-06T13:49:13.727168+0000","last_active":"2023-03-06T13:49:14.714385+0000","last_peered":"2023-03-06T13:49:14.714385+0000","last_clean":"2023-03-06T13:49:14.714385+0000","last_became_active":"2023-03-06T13:49:13.726711+0000","last_became_peered":"2023-03-06T13:49:13.726711+0000","last_unstale":"2023-03-06T13:49:14.714385+0000","last_undegraded":"2023-03-06T13:49:14.714385+0000","last_fullsized":"2023-03-06T13:49:14.714385+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T19:41:30.016073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:13.714161+0000","last_change":"2023-03-06T13:49:08.699699+0000","last_active":"2023-03-06T13:49:13.714161+0000","last_peered":"2023-03-06T13:49:13.714161+0000","last_clean":"2023-03-06T13:49:13.714161+0000","last_became_active":"2023-03-06T13:49:08.699396+0000","last_became_peered":"2023-03-06T13:49:08.699396+0000","last_unstale":"2023-03-06T13:49:13.714161+0000","last_undegraded":"2023-03-06T13:49:13.714161+0000","last_fullsized":"2023-03-06T13:49:13.714161+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:07.278421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:07.278421+0000","last_clean_scrub_stamp":"2023-03-06T13:49:07.278421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-08T01:22:20.301600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:13.714388+0000","last_change":"2023-03-06T13:49:13.336126+0000","last_active":"2023-03-06T13:49:13.714388+0000","last_peered":"2023-03-06T13:49:13.714388+0000","last_clean":"2023-03-06T13:49:13.714388+0000","last_became_active":"2023-03-06T13:49:13.335530+0000","last_became_peered":"2023-03-06T13:49:13.335530+0000","last_unstale":"2023-03-06T13:49:13.714388+0000","last_undegraded":"2023-03-06T13:49:13.714388+0000","last_fullsized":"2023-03-06T13:49:13.714388+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_clean_scrub_stamp":"2023-03-06T13:49:12.303785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T16:21:43.998829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-06T13:49:14.714365+0000","last_change":"2023-03-06T13:49:13.727824+0000","last_active":"2023-03-06T13:49:14.714365+0000","last_peered":"2023-03-06T13:49:14.714365+0000","last_clean":"2023-03-06T13:49:14.714365+0000","last_became_active":"2023-03-06T13:49:13.727472+0000","last_became_peered":"2023-03-06T13:49:13.727472+0000","last_unstale":"2023-03-06T13:49:14.714365+0000","last_undegraded":"2023-03-06T13:49:14.714365+0000","last_fullsized":"2023-03-06T13:49:14.714365+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T22:37:42.599167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-03-06T13:49:13.327993+0000","last_change":"2023-03-06T13:49:08.306975+0000","last_active":"2023-03-06T13:49:13.327993+0000","last_peered":"2023-03-06T13:49:13.327993+0000","last_clean":"2023-03-06T13:49:13.327993+0000","last_became_active":"2023-03-06T13:49:08.306669+0000","last_became_peered":"2023-03-06T13:49:08.306669+0000","last_unstale":"2023-03-06T13:49:13.327993+0000","last_undegraded":"2023-03-06T13:49:13.327993+0000","last_fullsized":"2023-03-06T13:49:13.327993+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:07.278421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:07.278421+0000","last_clean_scrub_stamp":"2023-03-06T13:49:07.278421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T19:54:04.557386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:13.724620+0000","last_change":"2023-03-06T13:49:13.327601+0000","last_active":"2023-03-06T13:49:13.724620+0000","last_peered":"2023-03-06T13:49:13.724620+0000","last_clean":"2023-03-06T13:49:13.724620+0000","last_became_active":"2023-03-06T13:49:13.327317+0000","last_became_peered":"2023-03-06T13:49:13.327317+0000","last_unstale":"2023-03-06T13:49:13.724620+0000","last_undegraded":"2023-03-06T13:49:13.724620+0000","last_fullsized":"2023-03-06T13:49:13.724620+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_clean_scrub_stamp":"2023-03-06T13:49:12.303785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T19:15:21.274175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-06T13:49:14.714429+0000","last_change":"2023-03-06T13:49:13.728830+0000","last_active":"2023-03-06T13:49:14.714429+0000","last_peered":"2023-03-06T13:49:14.714429+0000","last_clean":"2023-03-06T13:49:14.714429+0000","last_became_active":"2023-03-06T13:49:13.726036+0000","last_became_peered":"2023-03-06T13:49:13.726036+0000","last_unstale":"2023-03-06T13:49:14.714429+0000","last_undegraded":"2023-03-06T13:49:14.714429+0000","last_fullsized":"2023-03-06T13:49:14.714429+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T15:06:01.435712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-03-06T13:49:13.327233+0000","last_change":"2023-03-06T13:49:08.314061+0000","last_active":"2023-03-06T13:49:13.327233+0000","last_peered":"2023-03-06T13:49:13.327233+0000","last_clean":"2023-03-06T13:49:13.327233+0000","last_became_active":"2023-03-06T13:49:08.313713+0000","last_became_peered":"2023-03-06T13:49:08.313713+0000","last_unstale":"2023-03-06T13:49:13.327233+0000","last_undegraded":"2023-03-06T13:49:13.327233+0000","last_fullsized":"2023-03-06T13:49:13.327233+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:07.278421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:07.278421+0000","last_clean_scrub_stamp":"2023-03-06T13:49:07.278421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T15:29:35.587025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-06T13:49:14.713974+0000","last_change":"2023-03-06T13:49:13.331494+0000","last_active":"2023-03-06T13:49:14.713974+0000","last_peered":"2023-03-06T13:49:14.713974+0000","last_clean":"2023-03-06T13:49:14.713974+0000","last_became_active":"2023-03-06T13:49:13.331229+0000","last_became_peered":"2023-03-06T13:49:13.331229+0000","last_unstale":"2023-03-06T13:49:14.713974+0000","last_undegraded":"2023-03-06T13:49:14.713974+0000","last_fullsized":"2023-03-06T13:49:14.713974+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_clean_scrub_stamp":"2023-03-06T13:49:12.303785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T19:53:34.681954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-06T13:49:14.714342+0000","last_change":"2023-03-06T13:49:13.727756+0000","last_active":"2023-03-06T13:49:14.714342+0000","last_peered":"2023-03-06T13:49:14.714342+0000","last_clean":"2023-03-06T13:49:14.714342+0000","last_became_active":"2023-03-06T13:49:13.727509+0000","last_became_peered":"2023-03-06T13:49:13.727509+0000","last_unstale":"2023-03-06T13:49:14.714342+0000","last_undegraded":"2023-03-06T13:49:14.714342+0000","last_fullsized":"2023-03-06T13:49:14.714342+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T16:46:29.744316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-03-06T13:49:13.327616+0000","last_change":"2023-03-06T13:49:08.307053+0000","last_active":"2023-03-06T13:49:13.327616+0000","last_peered":"2023-03-06T13:49:13.327616+0000","last_clean":"2023-03-06T13:49:13.327616+0000","last_became_active":"2023-03-06T13:49:08.306737+0000","last_became_peered":"2023-03-06T13:49:08.306737+0000","last_unstale":"2023-03-06T13:49:13.327616+0000","last_undegraded":"2023-03-06T13:49:13.327616+0000","last_fullsized":"2023-03-06T13:49:13.327616+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:07.278421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:07.278421+0000","last_clean_scrub_stamp":"2023-03-06T13:49:07.278421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T21:59:33.265276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":166,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-03-06T13:49:13.326492+0000","last_change":"2023-03-06T13:49:01.912106+0000","last_active":"2023-03-06T13:49:13.326492+0000","last_peered":"2023-03-06T13:49:13.326492+0000","last_clean":"2023-03-06T13:49:13.326492+0000","last_became_active":"2023-03-06T13:49:01.911157+0000","last_became_peered":"2023-03-06T13:49:01.911157+0000","last_unstale":"2023-03-06T13:49:13.326492+0000","last_undegraded":"2023-03-06T13:49:13.326492+0000","last_fullsized":"2023-03-06T13:49:13.326492+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:00.859533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:00.859533+0000","last_clean_scrub_stamp":"2023-03-06T13:49:00.859533+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T21:39:16.753876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:13.712992+0000","last_change":"2023-03-06T13:49:13.335291+0000","last_active":"2023-03-06T13:49:13.712992+0000","last_peered":"2023-03-06T13:49:13.712992+0000","last_clean":"2023-03-06T13:49:13.712992+0000","last_became_active":"2023-03-06T13:49:13.334976+0000","last_became_peered":"2023-03-06T13:49:13.334976+0000","last_unstale":"2023-03-06T13:49:13.712992+0000","last_undegraded":"2023-03-06T13:49:13.712992+0000","last_fullsized":"2023-03-06T13:49:13.712992+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_clean_scrub_stamp":"2023-03-06T13:49:12.303785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-08T01:45:44.452690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-06T13:49:14.715835+0000","last_change":"2023-03-06T13:49:13.730668+0000","last_active":"2023-03-06T13:49:14.715835+0000","last_peered":"2023-03-06T13:49:14.715835+0000","last_clean":"2023-03-06T13:49:14.715835+0000","last_became_active":"2023-03-06T13:49:13.730191+0000","last_became_peered":"2023-03-06T13:49:13.730191+0000","last_unstale":"2023-03-06T13:49:14.715835+0000","last_undegraded":"2023-03-06T13:49:14.715835+0000","last_fullsized":"2023-03-06T13:49:14.715835+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T20:23:18.245157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-03-06T13:49:13.326603+0000","last_change":"2023-03-06T13:49:08.307071+0000","last_active":"2023-03-06T13:49:13.326603+0000","last_peered":"2023-03-06T13:49:13.326603+0000","last_clean":"2023-03-06T13:49:13.326603+0000","last_became_active":"2023-03-06T13:49:08.306682+0000","last_became_peered":"2023-03-06T13:49:08.306682+0000","last_unstale":"2023-03-06T13:49:13.326603+0000","last_undegraded":"2023-03-06T13:49:13.326603+0000","last_fullsized":"2023-03-06T13:49:13.326603+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:07.278421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:07.278421+0000","last_clean_scrub_stamp":"2023-03-06T13:49:07.278421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T19:54:04.557386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:13.716963+0000","last_change":"2023-03-06T13:49:13.331989+0000","last_active":"2023-03-06T13:49:13.716963+0000","last_peered":"2023-03-06T13:49:13.716963+0000","last_clean":"2023-03-06T13:49:13.716963+0000","last_became_active":"2023-03-06T13:49:13.331679+0000","last_became_peered":"2023-03-06T13:49:13.331679+0000","last_unstale":"2023-03-06T13:49:13.716963+0000","last_undegraded":"2023-03-06T13:49:13.716963+0000","last_fullsized":"2023-03-06T13:49:13.716963+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_clean_scrub_stamp":"2023-03-06T13:49:12.303785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T19:53:34.681954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:13.728704+0000","last_change":"2023-03-06T13:49:13.722056+0000","last_active":"2023-03-06T13:49:13.728704+0000","last_peered":"2023-03-06T13:49:13.728704+0000","last_clean":"2023-03-06T13:49:13.728704+0000","last_became_active":"2023-03-06T13:49:13.721792+0000","last_became_peered":"2023-03-06T13:49:13.721792+0000","last_unstale":"2023-03-06T13:49:13.728704+0000","last_undegraded":"2023-03-06T13:49:13.728704+0000","last_fullsized":"2023-03-06T13:49:13.728704+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T22:37:42.599167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-03-06T13:49:13.327257+0000","last_change":"2023-03-06T13:49:08.699801+0000","last_active":"2023-03-06T13:49:13.327257+0000","last_peered":"2023-03-06T13:49:13.327257+0000","last_clean":"2023-03-06T13:49:13.327257+0000","last_became_active":"2023-03-06T13:49:08.699514+0000","last_became_peered":"2023-03-06T13:49:08.699514+0000","last_unstale":"2023-03-06T13:49:13.327257+0000","last_undegraded":"2023-03-06T13:49:13.327257+0000","last_fullsized":"2023-03-06T13:49:13.327257+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:07.278421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:07.278421+0000","last_clean_scrub_stamp":"2023-03-06T13:49:07.278421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-08T00:50:49.893386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-06T13:49:14.714510+0000","last_change":"2023-03-06T13:49:13.332420+0000","last_active":"2023-03-06T13:49:14.714510+0000","last_peered":"2023-03-06T13:49:14.714510+0000","last_clean":"2023-03-06T13:49:14.714510+0000","last_became_active":"2023-03-06T13:49:13.332115+0000","last_became_peered":"2023-03-06T13:49:13.332115+0000","last_unstale":"2023-03-06T13:49:14.714510+0000","last_undegraded":"2023-03-06T13:49:14.714510+0000","last_fullsized":"2023-03-06T13:49:14.714510+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_clean_scrub_stamp":"2023-03-06T13:49:12.303785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T20:52:58.439733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:13.729882+0000","last_change":"2023-03-06T13:49:13.728080+0000","last_active":"2023-03-06T13:49:13.729882+0000","last_peered":"2023-03-06T13:49:13.729882+0000","last_clean":"2023-03-06T13:49:13.729882+0000","last_became_active":"2023-03-06T13:49:13.727805+0000","last_became_peered":"2023-03-06T13:49:13.727805+0000","last_unstale":"2023-03-06T13:49:13.729882+0000","last_undegraded":"2023-03-06T13:49:13.729882+0000","last_fullsized":"2023-03-06T13:49:13.729882+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-08T01:30:43.884806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"22'2","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:13.730457+0000","last_change":"2023-03-06T13:49:13.333399+0000","last_active":"2023-03-06T13:49:13.730457+0000","last_peered":"2023-03-06T13:49:13.730457+0000","last_clean":"2023-03-06T13:49:13.730457+0000","last_became_active":"2023-03-06T13:49:13.333083+0000","last_became_peered":"2023-03-06T13:49:13.333083+0000","last_unstale":"2023-03-06T13:49:13.730457+0000","last_undegraded":"2023-03-06T13:49:13.730457+0000","last_fullsized":"2023-03-06T13:49:13.730457+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_clean_scrub_stamp":"2023-03-06T13:49:12.303785+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T19:26:48.272662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:13.714043+0000","last_change":"2023-03-06T13:49:08.303113+0000","last_active":"2023-03-06T13:49:13.714043+0000","last_peered":"2023-03-06T13:49:13.714043+0000","last_clean":"2023-03-06T13:49:13.714043+0000","last_became_active":"2023-03-06T13:49:08.302803+0000","last_became_peered":"2023-03-06T13:49:08.302803+0000","last_unstale":"2023-03-06T13:49:13.714043+0000","last_undegraded":"2023-03-06T13:49:13.714043+0000","last_fullsized":"2023-03-06T13:49:13.714043+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:07.278421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:07.278421+0000","last_clean_scrub_stamp":"2023-03-06T13:49:07.278421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T15:29:35.587025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:13.730332+0000","last_change":"2023-03-06T13:49:13.726793+0000","last_active":"2023-03-06T13:49:13.730332+0000","last_peered":"2023-03-06T13:49:13.730332+0000","last_clean":"2023-03-06T13:49:13.730332+0000","last_became_active":"2023-03-06T13:49:13.726528+0000","last_became_peered":"2023-03-06T13:49:13.726528+0000","last_unstale":"2023-03-06T13:49:13.730332+0000","last_undegraded":"2023-03-06T13:49:13.730332+0000","last_fullsized":"2023-03-06T13:49:13.730332+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T17:11:13.619652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:13.714479+0000","last_change":"2023-03-06T13:49:08.302357+0000","last_active":"2023-03-06T13:49:13.714479+0000","last_peered":"2023-03-06T13:49:13.714479+0000","last_clean":"2023-03-06T13:49:13.714479+0000","last_became_active":"2023-03-06T13:49:08.302038+0000","last_became_peered":"2023-03-06T13:49:08.302038+0000","last_unstale":"2023-03-06T13:49:13.714479+0000","last_undegraded":"2023-03-06T13:49:13.714479+0000","last_fullsized":"2023-03-06T13:49:13.714479+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:07.278421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:07.278421+0000","last_clean_scrub_stamp":"2023-03-06T13:49:07.278421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-08T01:22:20.301600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:13.717093+0000","last_change":"2023-03-06T13:49:13.327179+0000","last_active":"2023-03-06T13:49:13.717093+0000","last_peered":"2023-03-06T13:49:13.717093+0000","last_clean":"2023-03-06T13:49:13.717093+0000","last_became_active":"2023-03-06T13:49:13.326813+0000","last_became_peered":"2023-03-06T13:49:13.326813+0000","last_unstale":"2023-03-06T13:49:13.717093+0000","last_undegraded":"2023-03-06T13:49:13.717093+0000","last_fullsized":"2023-03-06T13:49:13.717093+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_clean_scrub_stamp":"2023-03-06T13:49:12.303785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-08T01:45:44.452690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:13.736313+0000","last_change":"2023-03-06T13:49:13.733789+0000","last_active":"2023-03-06T13:49:13.736313+0000","last_peered":"2023-03-06T13:49:13.736313+0000","last_clean":"2023-03-06T13:49:13.736313+0000","last_became_active":"2023-03-06T13:49:13.733499+0000","last_became_peered":"2023-03-06T13:49:13.733499+0000","last_unstale":"2023-03-06T13:49:13.736313+0000","last_undegraded":"2023-03-06T13:49:13.736313+0000","last_fullsized":"2023-03-06T13:49:13.736313+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-08T00:51:17.885729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"22'1","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:13.733563+0000","last_change":"2023-03-06T13:49:13.330776+0000","last_active":"2023-03-06T13:49:13.733563+0000","last_peered":"2023-03-06T13:49:13.733563+0000","last_clean":"2023-03-06T13:49:13.733563+0000","last_became_active":"2023-03-06T13:49:13.330380+0000","last_became_peered":"2023-03-06T13:49:13.330380+0000","last_unstale":"2023-03-06T13:49:13.733563+0000","last_undegraded":"2023-03-06T13:49:13.733563+0000","last_fullsized":"2023-03-06T13:49:13.733563+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_clean_scrub_stamp":"2023-03-06T13:49:12.303785+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T16:21:43.998829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:13.725303+0000","last_change":"2023-03-06T13:49:13.721742+0000","last_active":"2023-03-06T13:49:13.725303+0000","last_peered":"2023-03-06T13:49:13.725303+0000","last_clean":"2023-03-06T13:49:13.725303+0000","last_became_active":"2023-03-06T13:49:13.721486+0000","last_became_peered":"2023-03-06T13:49:13.721486+0000","last_unstale":"2023-03-06T13:49:13.725303+0000","last_undegraded":"2023-03-06T13:49:13.725303+0000","last_fullsized":"2023-03-06T13:49:13.725303+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T19:26:49.277016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"22'2","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:13.735662+0000","last_change":"2023-03-06T13:49:13.335557+0000","last_active":"2023-03-06T13:49:13.735662+0000","last_peered":"2023-03-06T13:49:13.735662+0000","last_clean":"2023-03-06T13:49:13.735662+0000","last_became_active":"2023-03-06T13:49:13.335187+0000","last_became_peered":"2023-03-06T13:49:13.335187+0000","last_unstale":"2023-03-06T13:49:13.735662+0000","last_undegraded":"2023-03-06T13:49:13.735662+0000","last_fullsized":"2023-03-06T13:49:13.735662+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_clean_scrub_stamp":"2023-03-06T13:49:12.303785+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T20:23:17.240803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:13.737123+0000","last_change":"2023-03-06T13:49:13.735885+0000","last_active":"2023-03-06T13:49:13.737123+0000","last_peered":"2023-03-06T13:49:13.737123+0000","last_clean":"2023-03-06T13:49:13.737123+0000","last_became_active":"2023-03-06T13:49:13.735406+0000","last_became_peered":"2023-03-06T13:49:13.735406+0000","last_unstale":"2023-03-06T13:49:13.737123+0000","last_undegraded":"2023-03-06T13:49:13.737123+0000","last_fullsized":"2023-03-06T13:49:13.737123+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T20:35:34.805878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"22'2","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:13.731520+0000","last_change":"2023-03-06T13:49:13.331444+0000","last_active":"2023-03-06T13:49:13.731520+0000","last_peered":"2023-03-06T13:49:13.731520+0000","last_clean":"2023-03-06T13:49:13.731520+0000","last_became_active":"2023-03-06T13:49:13.331144+0000","last_became_peered":"2023-03-06T13:49:13.331144+0000","last_unstale":"2023-03-06T13:49:13.731520+0000","last_undegraded":"2023-03-06T13:49:13.731520+0000","last_fullsized":"2023-03-06T13:49:13.731520+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_clean_scrub_stamp":"2023-03-06T13:49:12.303785+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T19:17:35.350354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:13.737308+0000","last_change":"2023-03-06T13:49:13.736068+0000","last_active":"2023-03-06T13:49:13.737308+0000","last_peered":"2023-03-06T13:49:13.737308+0000","last_clean":"2023-03-06T13:49:13.737308+0000","last_became_active":"2023-03-06T13:49:13.735570+0000","last_became_peered":"2023-03-06T13:49:13.735570+0000","last_unstale":"2023-03-06T13:49:13.737308+0000","last_undegraded":"2023-03-06T13:49:13.737308+0000","last_fullsized":"2023-03-06T13:49:13.737308+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T20:03:32.232238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"22'1","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:13.733823+0000","last_change":"2023-03-06T13:49:13.328915+0000","last_active":"2023-03-06T13:49:13.733823+0000","last_peered":"2023-03-06T13:49:13.733823+0000","last_clean":"2023-03-06T13:49:13.733823+0000","last_became_active":"2023-03-06T13:49:13.328550+0000","last_became_peered":"2023-03-06T13:49:13.328550+0000","last_unstale":"2023-03-06T13:49:13.733823+0000","last_undegraded":"2023-03-06T13:49:13.733823+0000","last_fullsized":"2023-03-06T13:49:13.733823+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_clean_scrub_stamp":"2023-03-06T13:49:12.303785+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T14:43:51.863266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:13.734221+0000","last_change":"2023-03-06T13:49:13.727624+0000","last_active":"2023-03-06T13:49:13.734221+0000","last_peered":"2023-03-06T13:49:13.734221+0000","last_clean":"2023-03-06T13:49:13.734221+0000","last_became_active":"2023-03-06T13:49:13.727000+0000","last_became_peered":"2023-03-06T13:49:13.727000+0000","last_unstale":"2023-03-06T13:49:13.734221+0000","last_undegraded":"2023-03-06T13:49:13.734221+0000","last_fullsized":"2023-03-06T13:49:13.734221+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T15:06:01.435712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"22'4","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:13.730223+0000","last_change":"2023-03-06T13:49:13.334970+0000","last_active":"2023-03-06T13:49:13.730223+0000","last_peered":"2023-03-06T13:49:13.730223+0000","last_clean":"2023-03-06T13:49:13.730223+0000","last_became_active":"2023-03-06T13:49:13.334697+0000","last_became_peered":"2023-03-06T13:49:13.334697+0000","last_unstale":"2023-03-06T13:49:13.730223+0000","last_undegraded":"2023-03-06T13:49:13.730223+0000","last_fullsized":"2023-03-06T13:49:13.730223+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_clean_scrub_stamp":"2023-03-06T13:49:12.303785+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T20:23:17.240803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":566,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:13.734259+0000","last_change":"2023-03-06T13:49:13.728290+0000","last_active":"2023-03-06T13:49:13.734259+0000","last_peered":"2023-03-06T13:49:13.734259+0000","last_clean":"2023-03-06T13:49:13.734259+0000","last_became_active":"2023-03-06T13:49:13.727708+0000","last_became_peered":"2023-03-06T13:49:13.727708+0000","last_unstale":"2023-03-06T13:49:13.734259+0000","last_undegraded":"2023-03-06T13:49:13.734259+0000","last_fullsized":"2023-03-06T13:49:13.734259+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T16:42:39.878112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-06T13:49:14.715385+0000","last_change":"2023-03-06T13:49:13.723965+0000","last_active":"2023-03-06T13:49:14.715385+0000","last_peered":"2023-03-06T13:49:14.715385+0000","last_clean":"2023-03-06T13:49:14.715385+0000","last_became_active":"2023-03-06T13:49:13.723661+0000","last_became_peered":"2023-03-06T13:49:13.723661+0000","last_unstale":"2023-03-06T13:49:14.715385+0000","last_undegraded":"2023-03-06T13:49:14.715385+0000","last_fullsized":"2023-03-06T13:49:14.715385+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T23:31:39.512892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:13.737159+0000","last_change":"2023-03-06T13:49:13.731877+0000","last_active":"2023-03-06T13:49:13.737159+0000","last_peered":"2023-03-06T13:49:13.737159+0000","last_clean":"2023-03-06T13:49:13.737159+0000","last_became_active":"2023-03-06T13:49:13.728168+0000","last_became_peered":"2023-03-06T13:49:13.728168+0000","last_unstale":"2023-03-06T13:49:13.737159+0000","last_undegraded":"2023-03-06T13:49:13.737159+0000","last_fullsized":"2023-03-06T13:49:13.737159+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T18:43:12.631018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:13.734927+0000","last_change":"2023-03-06T13:49:13.730062+0000","last_active":"2023-03-06T13:49:13.734927+0000","last_peered":"2023-03-06T13:49:13.734927+0000","last_clean":"2023-03-06T13:49:13.734927+0000","last_became_active":"2023-03-06T13:49:13.729782+0000","last_became_peered":"2023-03-06T13:49:13.729782+0000","last_unstale":"2023-03-06T13:49:13.734927+0000","last_undegraded":"2023-03-06T13:49:13.734927+0000","last_fullsized":"2023-03-06T13:49:13.734927+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-08T01:30:43.884806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:13.730194+0000","last_change":"2023-03-06T13:49:13.725113+0000","last_active":"2023-03-06T13:49:13.730194+0000","last_peered":"2023-03-06T13:49:13.730194+0000","last_clean":"2023-03-06T13:49:13.730194+0000","last_became_active":"2023-03-06T13:49:13.724824+0000","last_became_peered":"2023-03-06T13:49:13.724824+0000","last_unstale":"2023-03-06T13:49:13.730194+0000","last_undegraded":"2023-03-06T13:49:13.730194+0000","last_fullsized":"2023-03-06T13:49:13.730194+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T20:18:58.498628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-06T13:49:14.714309+0000","last_change":"2023-03-06T13:49:13.724393+0000","last_active":"2023-03-06T13:49:14.714309+0000","last_peered":"2023-03-06T13:49:14.714309+0000","last_clean":"2023-03-06T13:49:14.714309+0000","last_became_active":"2023-03-06T13:49:13.724134+0000","last_became_peered":"2023-03-06T13:49:13.724134+0000","last_unstale":"2023-03-06T13:49:14.714309+0000","last_undegraded":"2023-03-06T13:49:14.714309+0000","last_fullsized":"2023-03-06T13:49:14.714309+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T23:04:29.575987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2330,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9096,"kb_used_data":832,"kb_used_omap":0,"kb_used_meta":8256,"kb_avail":94362744,"statfs":{"total":96636764160,"available":96627449856,"internally_reserved":0,"allocated":851968,"data_stored":675078,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8454144},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51100000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56899999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.501}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54300000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34999999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39800000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42199999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7976,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":7744,"kb_avail":94363864,"statfs":{"total":96636764160,"available":96628596736,"internally_reserved":0,"allocated":229376,"data_stored":82946,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7929856},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58299999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56499999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59599999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.625}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68100000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61199999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63700000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7976,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":7744,"kb_avail":94363864,"statfs":{"total":96636764160,"available":96628596736,"internally_reserved":0,"allocated":229376,"data_stored":82946,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7929856},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27700000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32300000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30499999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58099999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54300000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57099999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56299999999999994}]}]},{"osd":0,"up_from":13,"seq":55834574852,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9072,"kb_used_data":808,"kb_used_omap":0,"kb_used_meta":8256,"kb_avail":94362768,"statfs":{"total":96636764160,"available":96627474432,"internally_reserved":0,"allocated":827392,"data_stored":673880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8454144},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27900000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.316}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41999999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.503}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52500000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54000000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57899999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7912,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":7680,"kb_avail":94363928,"statfs":{"total":96636764160,"available":96628662272,"internally_reserved":0,"allocated":229376,"data_stored":82946,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7864320},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32400000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35199999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26200000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46700000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.432}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.504}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53200000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8044,"kb_used_data":228,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363796,"statfs":{"total":96636764160,"available":96628527104,"internally_reserved":0,"allocated":233472,"data_stored":83036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.376}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39300000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45800000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65600000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58699999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70399999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69199999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8060,"kb_used_data":244,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363780,"statfs":{"total":96636764160,"available":96628510720,"internally_reserved":0,"allocated":249856,"data_stored":84550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39800000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.374}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52100000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36099999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32400000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54900000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48099999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7984,"kb_used_data":232,"kb_used_omap":0,"kb_used_meta":7744,"kb_avail":94363856,"statfs":{"total":96636764160,"available":96628588544,"internally_reserved":0,"allocated":237568,"data_stored":83582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7929856},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33700000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41699999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45300000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.437}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36499999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52700000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47499999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-03-06T13:49:18.159 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-03-06T13:49:18.161 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-03-06T13:49:18.161 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-03-06T13:49:18.162 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-03-06T13:49:18.162 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-03-06T13:49:18.311 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:18.309+0000 7f590794c700 1 Processor -- start 2023-03-06T13:49:18.311 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:18.309+0000 7f590794c700 1 -- start start 2023-03-06T13:49:18.313 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:18.310+0000 7f590794c700 1 --2- >> v2:172.21.15.202:3300/0 conn(0x7f5900149420 0x7f59000c2860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:18.313 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:18.310+0000 7f590794c700 1 --2- >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f59000c2da0 0x7f590014f0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:18.314 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:18.310+0000 7f590794c700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5900153340 con 0x7f590006ea90 2023-03-06T13:49:18.314 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:18.310+0000 7f590794c700 1 -- --> v2:172.21.15.202:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59001497f0 con 0x7f5900149420 2023-03-06T13:49:18.314 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:18.310+0000 7f590794c700 1 -- --> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5900152750 con 0x7f59000c2da0 2023-03-06T13:49:18.314 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:18.310+0000 7f5905ee9700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f590006ea90 0x7f590006a330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:48834/0 (socket says 172.21.15.86:48834) 2023-03-06T13:49:18.314 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:18.310+0000 7f5905ee9700 1 -- 172.21.15.86:0/3682736522 learned_addr learned my addr 172.21.15.86:0/3682736522 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-03-06T13:49:18.314 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:18.310+0000 7f5904ee7700 1 --2- 172.21.15.86:0/3682736522 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f59000c2da0 0x7f590014f0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:18.314 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:18.310+0000 7f59056e8700 1 --2- 172.21.15.86:0/3682736522 >> v2:172.21.15.202:3300/0 conn(0x7f5900149420 0x7f59000c2860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:18.315 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:18.310+0000 7f58f7fff700 1 -- 172.21.15.86:0/3682736522 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3218913609 0 0) 0x7f5900153340 con 0x7f590006ea90 2023-03-06T13:49:18.315 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:18.310+0000 7f58f7fff700 1 -- 172.21.15.86:0/3682736522 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f58ec0035b0 con 0x7f590006ea90 2023-03-06T13:49:18.315 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:18.311+0000 7f59056e8700 1 -- 172.21.15.86:0/3682736522 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f59000c2da0 msgr2=0x7f590014f0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T13:49:18.315 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:18.311+0000 7f59056e8700 1 --2- 172.21.15.86:0/3682736522 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f59000c2da0 0x7f590014f0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:18.315 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:18.311+0000 7f59056e8700 1 -- 172.21.15.86:0/3682736522 >> v1:172.21.15.86:6789/0 conn(0x7f590006ea90 legacy=0x7f590006a330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:18.315 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:18.311+0000 7f59056e8700 1 -- 172.21.15.86:0/3682736522 --> v2:172.21.15.202:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5900152a10 con 0x7f5900149420 2023-03-06T13:49:18.316 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:18.311+0000 7f5904ee7700 1 --2- 172.21.15.86:0/3682736522 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f59000c2da0 0x7f590014f0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-06T13:49:18.316 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:18.311+0000 7f59056e8700 1 --2- 172.21.15.86:0/3682736522 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f5900149420 0x7f59000c2860 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f58fc009840 tx=0x7f58fc009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a49b0a38eb0e93dd server_cookie=0 in_seq=0 out_seq=0 2023-03-06T13:49:18.316 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:18.311+0000 7f58f7fff700 1 -- 172.21.15.86:0/3682736522 <== mon.1 v2:172.21.15.202:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58fc011830 con 0x7f5900149420 2023-03-06T13:49:18.316 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:18.311+0000 7f58f7fff700 1 -- 172.21.15.86:0/3682736522 <== mon.1 v2:172.21.15.202:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58fc011990 con 0x7f5900149420 2023-03-06T13:49:18.316 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:18.311+0000 7f58f7fff700 1 -- 172.21.15.86:0/3682736522 <== mon.1 v2:172.21.15.202:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58fc011d00 con 0x7f5900149420 2023-03-06T13:49:18.317 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:18.311+0000 7f590794c700 1 -- 172.21.15.86:0/3682736522 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f5900149420 msgr2=0x7f59000c2860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:18.317 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:18.312+0000 7f590794c700 1 --2- 172.21.15.86:0/3682736522 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f5900149420 0x7f59000c2860 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f58fc009840 tx=0x7f58fc009b50 comp rx=0 tx=0).stop 2023-03-06T13:49:18.317 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:18.312+0000 7f590794c700 1 -- 172.21.15.86:0/3682736522 shutdown_connections 2023-03-06T13:49:18.317 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:18.312+0000 7f590794c700 1 --2- 172.21.15.86:0/3682736522 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f5900149420 0x7f59000c2860 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:18.317 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:18.312+0000 7f590794c700 1 --2- 172.21.15.86:0/3682736522 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f59000c2da0 0x7f590014f0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:18.317 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:18.312+0000 7f590794c700 1 -- 172.21.15.86:0/3682736522 >> 172.21.15.86:0/3682736522 conn(0x7f590006c0d0 msgr2=0x7f59000c2150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T13:49:18.317 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:18.312+0000 7f590794c700 1 -- 172.21.15.86:0/3682736522 shutdown_connections 2023-03-06T13:49:18.318 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:18.312+0000 7f590794c700 1 -- 172.21.15.86:0/3682736522 wait complete. 2023-03-06T13:49:18.320 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:18.313+0000 7f590794c700 1 Processor -- start 2023-03-06T13:49:18.320 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:18.313+0000 7f590794c700 1 -- start start 2023-03-06T13:49:18.320 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:18.313+0000 7f590794c700 1 --2- >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f590006ea90 0x7f5900146910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:18.320 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:18.313+0000 7f590794c700 1 --2- >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f59000c2da0 0x7f5900143650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:18.320 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:18.313+0000 7f590794c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5900149420 0x7f5900143b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:18.320 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:18.313+0000 7f590794c700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5900146e50 con 0x7f5900149420 2023-03-06T13:49:18.320 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:18.313+0000 7f590794c700 1 -- --> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5900144700 con 0x7f59000c2da0 2023-03-06T13:49:18.321 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:18.313+0000 7f590794c700 1 -- --> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59001e8ca0 con 0x7f590006ea90 2023-03-06T13:49:18.321 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:18.313+0000 7f5905ee9700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5900149420 0x7f5900143b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:18.321 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:18.313+0000 7f5905ee9700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5900149420 0x7f5900143b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:38692/0 (socket says 172.21.15.86:38692) 2023-03-06T13:49:18.321 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:18.314+0000 7f5905ee9700 1 -- 172.21.15.86:0/4147104973 learned_addr learned my addr 172.21.15.86:0/4147104973 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-03-06T13:49:18.321 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:18.314+0000 7f59056e8700 1 --2- 172.21.15.86:0/4147104973 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f590006ea90 0x7f5900146910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:18.321 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:18.314+0000 7f5904ee7700 1 --2- 172.21.15.86:0/4147104973 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f59000c2da0 0x7f5900143650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:18.322 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:18.314+0000 7f5905ee9700 1 -- 172.21.15.86:0/4147104973 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f590006ea90 msgr2=0x7f5900146910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:18.322 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:18.314+0000 7f5905ee9700 1 --2- 172.21.15.86:0/4147104973 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f590006ea90 0x7f5900146910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:18.322 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:18.314+0000 7f5905ee9700 1 -- 172.21.15.86:0/4147104973 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f59000c2da0 msgr2=0x7f5900143650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:18.322 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:18.314+0000 7f5905ee9700 1 --2- 172.21.15.86:0/4147104973 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f59000c2da0 0x7f5900143650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:18.322 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:18.314+0000 7f5905ee9700 1 -- 172.21.15.86:0/4147104973 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58f00094a0 con 0x7f5900149420 2023-03-06T13:49:18.322 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:18.314+0000 7f5905ee9700 1 --2- 172.21.15.86:0/4147104973 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5900149420 0x7f5900143b90 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f58f800caa0 tx=0x7f58f800cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T13:49:18.322 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:18.314+0000 7f58f5ffb700 1 -- 172.21.15.86:0/4147104973 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58f800a9e0 con 0x7f5900149420 2023-03-06T13:49:18.323 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:18.314+0000 7f58f5ffb700 1 -- 172.21.15.86:0/4147104973 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58f800ab40 con 0x7f5900149420 2023-03-06T13:49:18.323 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:18.314+0000 7f590794c700 1 -- 172.21.15.86:0/4147104973 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58fc0094a0 con 0x7f5900149420 2023-03-06T13:49:18.323 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:18.314+0000 7f58f5ffb700 1 -- 172.21.15.86:0/4147104973 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58f8012400 con 0x7f5900149420 2023-03-06T13:49:18.323 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:18.314+0000 7f590794c700 1 -- 172.21.15.86:0/4147104973 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5900152fd0 con 0x7f5900149420 2023-03-06T13:49:18.323 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:18.315+0000 7f590794c700 1 -- 172.21.15.86:0/4147104973 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5900152cf0 con 0x7f5900149420 2023-03-06T13:49:18.323 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:18.315+0000 7f58f5ffb700 1 -- 172.21.15.86:0/4147104973 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f58f8019030 con 0x7f5900149420 2023-03-06T13:49:18.323 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:18.316+0000 7f58f5ffb700 1 --2- 172.21.15.86:0/4147104973 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7f58e40682f0 0x7f58e406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:18.323 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:18.316+0000 7f59056e8700 1 --2- 172.21.15.86:0/4147104973 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7f58e40682f0 0x7f58e406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:18.324 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:18.316+0000 7f58f5ffb700 1 -- 172.21.15.86:0/4147104973 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f58f80858c0 con 0x7f5900149420 2023-03-06T13:49:18.324 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:18.316+0000 7f59056e8700 1 --2- 172.21.15.86:0/4147104973 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7f58e40682f0 0x7f58e406a7a0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f58fc000c00 tx=0x7f58fc008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T13:49:18.324 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:18.320+0000 7f58f5ffb700 1 -- 172.21.15.86:0/4147104973 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f58f8052120 con 0x7f5900149420 2023-03-06T13:49:18.558 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:18.556+0000 7f590794c700 1 -- 172.21.15.86:0/4147104973 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f590006e610 con 0x7f5900149420 2023-03-06T13:49:18.560 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:18.559+0000 7f58f5ffb700 1 -- 172.21.15.86:0/4147104973 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+166376 (secure 0 0 0) 0x7f58f8055740 con 0x7f5900149420 2023-03-06T13:49:18.562 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-03-06T13:49:18.564 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:18.561+0000 7f590794c700 1 -- 172.21.15.86:0/4147104973 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7f58e40682f0 msgr2=0x7f58e406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:18.564 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:18.561+0000 7f590794c700 1 --2- 172.21.15.86:0/4147104973 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7f58e40682f0 0x7f58e406a7a0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f58fc000c00 tx=0x7f58fc008030 comp rx=0 tx=0).stop 2023-03-06T13:49:18.564 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:18.561+0000 7f590794c700 1 -- 172.21.15.86:0/4147104973 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5900149420 msgr2=0x7f5900143b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:18.564 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:18.561+0000 7f590794c700 1 --2- 172.21.15.86:0/4147104973 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5900149420 0x7f5900143b90 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f58f800caa0 tx=0x7f58f800cdb0 comp rx=0 tx=0).stop 2023-03-06T13:49:18.565 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:18.561+0000 7f590794c700 1 -- 172.21.15.86:0/4147104973 shutdown_connections 2023-03-06T13:49:18.565 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:18.561+0000 7f590794c700 1 --2- 172.21.15.86:0/4147104973 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7f58e40682f0 0x7f58e406a7a0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:18.565 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:18.561+0000 7f590794c700 1 --2- 172.21.15.86:0/4147104973 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5900149420 0x7f5900143b90 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:18.565 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:18.561+0000 7f590794c700 1 --2- 172.21.15.86:0/4147104973 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f590006ea90 0x7f5900146910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:18.565 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:18.561+0000 7f590794c700 1 --2- 172.21.15.86:0/4147104973 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f59000c2da0 0x7f5900143650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:18.565 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:18.561+0000 7f590794c700 1 -- 172.21.15.86:0/4147104973 >> 172.21.15.86:0/4147104973 conn(0x7f590006c0d0 msgr2=0x7f59000b7100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T13:49:18.565 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:18.561+0000 7f590794c700 1 -- 172.21.15.86:0/4147104973 shutdown_connections 2023-03-06T13:49:18.566 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:18.562+0000 7f590794c700 1 -- 172.21.15.86:0/4147104973 wait complete. 2023-03-06T13:49:18.575 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":5,"active_gid":4101,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":96468},{"type":"v1","addr":"172.21.15.86:6833","nonce":96468}]},"active_addr":"172.21.15.86:6833/96468","active_change":"2023-03-06T13:48:53.828166+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4111,"name":"x","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_password":{"name":"alertmanager_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web password","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_user":{"name":"alertmanager_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web user","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.23.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:8.3.5","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.3.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.33.4","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"prometheus_web_password":{"name":"prometheus_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web password","long_desc":"","tags":[],"see_also":[]},"prometheus_web_user":{"name":"prometheus_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web user","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_password":{"name":"alertmanager_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web password","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_user":{"name":"alertmanager_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web user","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.23.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:8.3.5","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.3.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.33.4","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"prometheus_web_password":{"name":"prometheus_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web password","long_desc":"","tags":[],"see_also":[]},"prometheus_web_user":{"name":"prometheus_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web user","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"addrvec":[{"type":"v2","addr":"172.21.15.86:0","nonce":3856652053}]},{"addrvec":[{"type":"v2","addr":"172.21.15.86:0","nonce":4028681396}]},{"addrvec":[{"type":"v2","addr":"172.21.15.86:0","nonce":2488691632}]},{"addrvec":[{"type":"v2","addr":"172.21.15.86:0","nonce":2441124173}]}]} 2023-03-06T13:49:18.581 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-03-06T13:49:18.581 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-03-06T13:49:18.582 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-03-06T13:49:18.701 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:18.699+0000 7f6ba53ed700 1 Processor -- start 2023-03-06T13:49:18.701 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:18.699+0000 7f6ba53ed700 1 -- start start 2023-03-06T13:49:18.704 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:18.699+0000 7f6ba53ed700 1 --2- >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f6ba006bcf0 0x7f6ba006c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:18.705 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:18.700+0000 7f6ba53ed700 1 --2- >> v2:172.21.15.202:3300/0 conn(0x7f6ba006a330 0x7f6ba00c32a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:18.705 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:18.700+0000 7f6ba53ed700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ba014fb40 con 0x7f6ba00c37e0 2023-03-06T13:49:18.706 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:18.700+0000 7f6ba53ed700 1 -- --> v2:172.21.15.202:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ba00c0060 con 0x7f6ba006a330 2023-03-06T13:49:18.706 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:18.700+0000 7f6ba53ed700 1 -- --> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ba00b8d00 con 0x7f6ba006bcf0 2023-03-06T13:49:18.706 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:18.700+0000 7f6b9f7fe700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f6ba00c37e0 0x7f6ba01526b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:48848/0 (socket says 172.21.15.86:48848) 2023-03-06T13:49:18.707 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:18.700+0000 7f6b9f7fe700 1 -- 172.21.15.86:0/2879099756 learned_addr learned my addr 172.21.15.86:0/2879099756 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-03-06T13:49:18.707 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:18.700+0000 7f6b9dffb700 1 -- 172.21.15.86:0/2879099756 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4250973076 0 0) 0x7f6ba014fb40 con 0x7f6ba00c37e0 2023-03-06T13:49:18.707 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:18.700+0000 7f6b9effd700 1 --2- 172.21.15.86:0/2879099756 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f6ba006bcf0 0x7f6ba006c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:18.708 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:18.700+0000 7f6b9dffb700 1 -- 172.21.15.86:0/2879099756 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6b880035b0 con 0x7f6ba00c37e0 2023-03-06T13:49:18.708 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:18.700+0000 7f6b9e7fc700 1 --2- 172.21.15.86:0/2879099756 >> v2:172.21.15.202:3300/0 conn(0x7f6ba006a330 0x7f6ba00c32a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:18.708 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:18.700+0000 7f6b9dffb700 1 -- 172.21.15.86:0/2879099756 <== mon.0 v1:172.21.15.86:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3155870118 0 0) 0x7f6b880035b0 con 0x7f6ba00c37e0 2023-03-06T13:49:18.708 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:18.700+0000 7f6b9dffb700 1 -- 172.21.15.86:0/2879099756 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f6ba006bcf0 msgr2=0x7f6ba006c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T13:49:18.709 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:18.700+0000 7f6b9dffb700 1 --2- 172.21.15.86:0/2879099756 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f6ba006bcf0 0x7f6ba006c0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:18.709 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:18.700+0000 7f6b9dffb700 1 -- 172.21.15.86:0/2879099756 >> v2:172.21.15.202:3300/0 conn(0x7f6ba006a330 msgr2=0x7f6ba00c32a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T13:49:18.710 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:18.700+0000 7f6b9dffb700 1 --2- 172.21.15.86:0/2879099756 >> v2:172.21.15.202:3300/0 conn(0x7f6ba006a330 0x7f6ba00c32a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:18.710 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:18.700+0000 7f6b9dffb700 1 -- 172.21.15.86:0/2879099756 --> v1:172.21.15.86:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ba00c3c20 con 0x7f6ba00c37e0 2023-03-06T13:49:18.710 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:18.700+0000 7f6b9dffb700 1 -- 172.21.15.86:0/2879099756 <== mon.0 v1:172.21.15.86:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2191261126 0 0) 0x7f6b980019f0 con 0x7f6ba00c37e0 2023-03-06T13:49:18.710 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:18.700+0000 7f6b9dffb700 1 -- 172.21.15.86:0/2879099756 >> v1:172.21.15.86:6789/0 conn(0x7f6ba00c37e0 legacy=0x7f6ba01526b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:18.710 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:18.700+0000 7f6b9dffb700 1 --2- 172.21.15.86:0/2879099756 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f6ba006bcf0 0x7f6b88003a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:18.711 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:18.700+0000 7f6b9dffb700 1 --2- 172.21.15.86:0/2879099756 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f6b88003ff0 0x7f6b88004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:18.711 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:18.700+0000 7f6b9dffb700 1 --2- 172.21.15.86:0/2879099756 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6b88004d90 0x7f6b88005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:18.711 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:18.700+0000 7f6b9dffb700 1 -- 172.21.15.86:0/2879099756 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ba00c0060 con 0x7f6b88004d90 2023-03-06T13:49:18.711 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:18.700+0000 7f6b9dffb700 1 -- 172.21.15.86:0/2879099756 --> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ba00b8d00 con 0x7f6b88003ff0 2023-03-06T13:49:18.711 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:18.700+0000 7f6b9dffb700 1 -- 172.21.15.86:0/2879099756 --> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b8800bb70 con 0x7f6ba006bcf0 2023-03-06T13:49:18.711 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:18.700+0000 7f6b9f7fe700 1 --2- 172.21.15.86:0/2879099756 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6b88004d90 0x7f6b88005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:18.711 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:18.700+0000 7f6b9effd700 1 --2- 172.21.15.86:0/2879099756 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f6ba006bcf0 0x7f6b88003a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:18.711 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:18.700+0000 7f6b9e7fc700 1 --2- 172.21.15.86:0/2879099756 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f6b88003ff0 0x7f6b88004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:18.712 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:18.701+0000 7f6b9f7fe700 1 -- 172.21.15.86:0/2879099756 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f6ba006bcf0 msgr2=0x7f6b88003a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T13:49:18.712 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:18.701+0000 7f6b9f7fe700 1 --2- 172.21.15.86:0/2879099756 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f6ba006bcf0 0x7f6b88003a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:18.712 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:18.701+0000 7f6b9f7fe700 1 -- 172.21.15.86:0/2879099756 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f6b88003ff0 msgr2=0x7f6b88004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T13:49:18.712 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:18.701+0000 7f6b9f7fe700 1 --2- 172.21.15.86:0/2879099756 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f6b88003ff0 0x7f6b88004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:18.712 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:18.701+0000 7f6b9f7fe700 1 -- 172.21.15.86:0/2879099756 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b880035b0 con 0x7f6b88004d90 2023-03-06T13:49:18.712 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:18.701+0000 7f6b9f7fe700 1 --2- 172.21.15.86:0/2879099756 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6b88004d90 0x7f6b88005200 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f6b9800a830 tx=0x7f6b88005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6abc709948523fe server_cookie=0 in_seq=0 out_seq=0 2023-03-06T13:49:18.712 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:18.701+0000 7f6b9dffb700 1 -- 172.21.15.86:0/2879099756 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b98012600 con 0x7f6b88004d90 2023-03-06T13:49:18.713 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:18.701+0000 7f6b9dffb700 1 -- 172.21.15.86:0/2879099756 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b98012780 con 0x7f6b88004d90 2023-03-06T13:49:18.713 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:18.701+0000 7f6b9dffb700 1 -- 172.21.15.86:0/2879099756 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b98012b30 con 0x7f6b88004d90 2023-03-06T13:49:18.713 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:18.701+0000 7f6ba53ed700 1 -- 172.21.15.86:0/2879099756 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6b88004d90 msgr2=0x7f6b88005200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:18.713 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:18.701+0000 7f6ba53ed700 1 --2- 172.21.15.86:0/2879099756 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6b88004d90 0x7f6b88005200 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f6b9800a830 tx=0x7f6b88005880 comp rx=0 tx=0).stop 2023-03-06T13:49:18.713 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:18.701+0000 7f6b9f7fe700 1 -- 172.21.15.86:0/2879099756 reap_dead start 2023-03-06T13:49:18.713 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:18.701+0000 7f6ba53ed700 1 -- 172.21.15.86:0/2879099756 shutdown_connections 2023-03-06T13:49:18.713 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:18.701+0000 7f6ba53ed700 1 -- 172.21.15.86:0/2879099756 >> 172.21.15.86:0/2879099756 conn(0x7f6ba00a6f40 msgr2=0x7f6ba00a7340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T13:49:18.714 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:18.701+0000 7f6ba53ed700 1 -- 172.21.15.86:0/2879099756 shutdown_connections 2023-03-06T13:49:18.714 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:18.701+0000 7f6ba53ed700 1 -- 172.21.15.86:0/2879099756 wait complete. 2023-03-06T13:49:18.714 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:18.703+0000 7f6ba53ed700 1 Processor -- start 2023-03-06T13:49:18.714 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:18.703+0000 7f6ba53ed700 1 -- start start 2023-03-06T13:49:18.716 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:18.703+0000 7f6ba53ed700 1 --2- >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f6b88004d90 0x7f6ba01e5fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:18.716 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:18.703+0000 7f6ba53ed700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6ba00aaf60 0x7f6ba00c1890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:18.716 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:18.703+0000 7f6ba53ed700 1 --2- >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f6ba00a93f0 0x7f6ba01e80b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:18.716 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:18.703+0000 7f6ba53ed700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ba00aaad0 con 0x7f6ba00aaf60 2023-03-06T13:49:18.717 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:18.703+0000 7f6ba53ed700 1 -- --> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ba01e64f0 con 0x7f6ba00a93f0 2023-03-06T13:49:18.717 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:18.703+0000 7f6ba53ed700 1 -- --> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ba00c20a0 con 0x7f6b88004d90 2023-03-06T13:49:18.717 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:18.703+0000 7f6b9e7fc700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6ba00aaf60 0x7f6ba00c1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:18.717 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:18.703+0000 7f6b9e7fc700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6ba00aaf60 0x7f6ba00c1890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:38710/0 (socket says 172.21.15.86:38710) 2023-03-06T13:49:18.717 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:18.703+0000 7f6b9e7fc700 1 -- 172.21.15.86:0/398459239 learned_addr learned my addr 172.21.15.86:0/398459239 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-03-06T13:49:18.717 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:18.703+0000 7f6b9effd700 1 --2- 172.21.15.86:0/398459239 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f6b88004d90 0x7f6ba01e5fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:18.717 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:18.703+0000 7f6b9f7fe700 1 --2- 172.21.15.86:0/398459239 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f6ba00a93f0 0x7f6ba01e80b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:18.718 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:18.704+0000 7f6b9e7fc700 1 -- 172.21.15.86:0/398459239 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f6b88004d90 msgr2=0x7f6ba01e5fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:18.718 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:18.704+0000 7f6b9e7fc700 1 --2- 172.21.15.86:0/398459239 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f6b88004d90 0x7f6ba01e5fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:18.718 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:18.704+0000 7f6b9e7fc700 1 -- 172.21.15.86:0/398459239 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f6ba00a93f0 msgr2=0x7f6ba01e80b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:18.718 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:18.704+0000 7f6b9e7fc700 1 --2- 172.21.15.86:0/398459239 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f6ba00a93f0 0x7f6ba01e80b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:18.718 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:18.704+0000 7f6b9e7fc700 1 -- 172.21.15.86:0/398459239 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ba014fd90 con 0x7f6ba00aaf60 2023-03-06T13:49:18.718 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:18.704+0000 7f6b9e7fc700 1 --2- 172.21.15.86:0/398459239 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6ba00aaf60 0x7f6ba00c1890 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f6b94011aa0 tx=0x7f6b94011db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T13:49:18.718 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:18.704+0000 7f6b877fe700 1 -- 172.21.15.86:0/398459239 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b94011ed0 con 0x7f6ba00aaf60 2023-03-06T13:49:18.719 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:18.704+0000 7f6b877fe700 1 -- 172.21.15.86:0/398459239 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b9400f940 con 0x7f6ba00aaf60 2023-03-06T13:49:18.719 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:18.704+0000 7f6ba53ed700 1 -- 172.21.15.86:0/398459239 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ba00c0300 con 0x7f6ba00aaf60 2023-03-06T13:49:18.719 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:18.704+0000 7f6b877fe700 1 -- 172.21.15.86:0/398459239 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b9400fd10 con 0x7f6ba00aaf60 2023-03-06T13:49:18.719 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:18.704+0000 7f6ba53ed700 1 -- 172.21.15.86:0/398459239 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ba00c51b0 con 0x7f6ba00aaf60 2023-03-06T13:49:18.719 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:18.705+0000 7f6ba53ed700 1 -- 172.21.15.86:0/398459239 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ba00aac80 con 0x7f6ba00aaf60 2023-03-06T13:49:18.719 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:18.705+0000 7f6b877fe700 1 -- 172.21.15.86:0/398459239 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f6b94014440 con 0x7f6ba00aaf60 2023-03-06T13:49:18.719 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:18.706+0000 7f6b877fe700 1 --2- 172.21.15.86:0/398459239 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7f6b8c0682f0 0x7f6b8c06a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:18.719 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:18.706+0000 7f6b9effd700 1 --2- 172.21.15.86:0/398459239 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7f6b8c0682f0 0x7f6b8c06a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:18.720 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:18.706+0000 7f6b877fe700 1 -- 172.21.15.86:0/398459239 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f6b94086430 con 0x7f6ba00aaf60 2023-03-06T13:49:18.720 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:18.706+0000 7f6b9effd700 1 --2- 172.21.15.86:0/398459239 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7f6b8c0682f0 0x7f6b8c06a7a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f6b90009c60 tx=0x7f6b90009210 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T13:49:18.720 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:18.710+0000 7f6b877fe700 1 -- 172.21.15.86:0/398459239 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f6ba00aac80 con 0x7f6ba00aaf60 2023-03-06T13:49:18.895 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:18.893+0000 7f6ba53ed700 1 -- 172.21.15.86:0/398459239 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6ba004e750 con 0x7f6ba00aaf60 2023-03-06T13:49:18.896 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:18.894+0000 7f6b877fe700 1 -- 172.21.15.86:0/398459239 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+17811 (secure 0 0 0) 0x7f6b94052cf0 con 0x7f6ba00aaf60 2023-03-06T13:49:18.897 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-03-06T13:49:18.897 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":23,"fsid":"2cca6c77-50cb-47d8-a8c7-444575d01327","created":"2023-03-06T13:48:48.337369+0000","modified":"2023-03-06T13:49:14.708570+0000","last_up_change":"2023-03-06T13:48:59.782729+0000","last_in_change":"2023-03-06T13:48:50.777249+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-03-06T13:48:59.879087+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-03-06T13:49:06.686394+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-03-06T13:49:11.362997+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-03-06T13:49:12.753969+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2de68e69-e10f-49e1-a15a-8a9bfff504c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":96739},{"type":"v1","addr":"172.21.15.86:6816","nonce":96739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":96739},{"type":"v1","addr":"172.21.15.86:6819","nonce":96739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":96739},{"type":"v1","addr":"172.21.15.86:6823","nonce":96739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":96739},{"type":"v1","addr":"172.21.15.86:6821","nonce":96739}]},"public_addr":"172.21.15.86:6816/96739","cluster_addr":"172.21.15.86:6819/96739","heartbeat_back_addr":"172.21.15.86:6823/96739","heartbeat_front_addr":"172.21.15.86:6821/96739","state":["exists","up"]},{"osd":1,"uuid":"3e75c061-0de5-4742-a20d-4b5a4adb9b81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":96738},{"type":"v1","addr":"172.21.15.86:6801","nonce":96738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":96738},{"type":"v1","addr":"172.21.15.86:6803","nonce":96738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":96738},{"type":"v1","addr":"172.21.15.86:6807","nonce":96738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":96738},{"type":"v1","addr":"172.21.15.86:6805","nonce":96738}]},"public_addr":"172.21.15.86:6801/96738","cluster_addr":"172.21.15.86:6803/96738","heartbeat_back_addr":"172.21.15.86:6807/96738","heartbeat_front_addr":"172.21.15.86:6805/96738","state":["exists","up"]},{"osd":2,"uuid":"38d71bce-81c2-4e33-91e1-65efb08f2291","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":96740},{"type":"v1","addr":"172.21.15.86:6809","nonce":96740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":96740},{"type":"v1","addr":"172.21.15.86:6811","nonce":96740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6815","nonce":96740},{"type":"v1","addr":"172.21.15.86:6817","nonce":96740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":96740},{"type":"v1","addr":"172.21.15.86:6813","nonce":96740}]},"public_addr":"172.21.15.86:6809/96740","cluster_addr":"172.21.15.86:6811/96740","heartbeat_back_addr":"172.21.15.86:6817/96740","heartbeat_front_addr":"172.21.15.86:6813/96740","state":["exists","up"]},{"osd":3,"uuid":"d95a2686-21bd-4b66-9ea5-eef65403935b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":96756},{"type":"v1","addr":"172.21.15.86:6825","nonce":96756}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":96756},{"type":"v1","addr":"172.21.15.86:6827","nonce":96756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":96756},{"type":"v1","addr":"172.21.15.86:6831","nonce":96756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":96756},{"type":"v1","addr":"172.21.15.86:6829","nonce":96756}]},"public_addr":"172.21.15.86:6825/96756","cluster_addr":"172.21.15.86:6827/96756","heartbeat_back_addr":"172.21.15.86:6831/96756","heartbeat_front_addr":"172.21.15.86:6829/96756","state":["exists","up"]},{"osd":4,"uuid":"98c7e359-0f00-496a-8aaa-5472af355e48","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.202:6816","nonce":96847},{"type":"v1","addr":"172.21.15.202:6817","nonce":96847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.202:6818","nonce":96847},{"type":"v1","addr":"172.21.15.202:6819","nonce":96847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.202:6822","nonce":96847},{"type":"v1","addr":"172.21.15.202:6823","nonce":96847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.202:6820","nonce":96847},{"type":"v1","addr":"172.21.15.202:6821","nonce":96847}]},"public_addr":"172.21.15.202:6817/96847","cluster_addr":"172.21.15.202:6819/96847","heartbeat_back_addr":"172.21.15.202:6823/96847","heartbeat_front_addr":"172.21.15.202:6821/96847","state":["exists","up"]},{"osd":5,"uuid":"fa6688d9-73f3-4593-a50e-d96a0fe5f4cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.202:6824","nonce":96848},{"type":"v1","addr":"172.21.15.202:6825","nonce":96848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.202:6826","nonce":96848},{"type":"v1","addr":"172.21.15.202:6827","nonce":96848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.202:6830","nonce":96848},{"type":"v1","addr":"172.21.15.202:6831","nonce":96848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.202:6828","nonce":96848},{"type":"v1","addr":"172.21.15.202:6829","nonce":96848}]},"public_addr":"172.21.15.202:6825/96848","cluster_addr":"172.21.15.202:6827/96848","heartbeat_back_addr":"172.21.15.202:6831/96848","heartbeat_front_addr":"172.21.15.202:6829/96848","state":["exists","up"]},{"osd":6,"uuid":"7bfc6dc0-2388-4498-9cd7-766e3606f6a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.202:6808","nonce":96845},{"type":"v1","addr":"172.21.15.202:6809","nonce":96845}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.202:6810","nonce":96845},{"type":"v1","addr":"172.21.15.202:6811","nonce":96845}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.202:6814","nonce":96845},{"type":"v1","addr":"172.21.15.202:6815","nonce":96845}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.202:6812","nonce":96845},{"type":"v1","addr":"172.21.15.202:6813","nonce":96845}]},"public_addr":"172.21.15.202:6809/96845","cluster_addr":"172.21.15.202:6811/96845","heartbeat_back_addr":"172.21.15.202:6815/96845","heartbeat_front_addr":"172.21.15.202:6813/96845","state":["exists","up"]},{"osd":7,"uuid":"c475f863-96fd-48e3-8033-7d1c3b1d503f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.202:6800","nonce":96846},{"type":"v1","addr":"172.21.15.202:6801","nonce":96846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.202:6802","nonce":96846},{"type":"v1","addr":"172.21.15.202:6803","nonce":96846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.202:6806","nonce":96846},{"type":"v1","addr":"172.21.15.202:6807","nonce":96846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.202:6804","nonce":96846},{"type":"v1","addr":"172.21.15.202:6805","nonce":96846}]},"public_addr":"172.21.15.202:6801/96846","cluster_addr":"172.21.15.202:6803/96846","heartbeat_back_addr":"172.21.15.202:6807/96846","heartbeat_front_addr":"172.21.15.202:6805/96846","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-06T13:48:55.997991+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-06T13:48:55.930805+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-06T13:48:56.000312+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-06T13:48:55.998360+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-06T13:48:56.052762+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-06T13:48:56.036049+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-06T13:48:56.048751+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-06T13:48:56.011928+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-03-06T13:49:18.899 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:18.897+0000 7f6ba53ed700 1 -- 172.21.15.86:0/398459239 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7f6b8c0682f0 msgr2=0x7f6b8c06a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:18.899 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:18.897+0000 7f6ba53ed700 1 --2- 172.21.15.86:0/398459239 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7f6b8c0682f0 0x7f6b8c06a7a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f6b90009c60 tx=0x7f6b90009210 comp rx=0 tx=0).stop 2023-03-06T13:49:18.899 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:18.897+0000 7f6ba53ed700 1 -- 172.21.15.86:0/398459239 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6ba00aaf60 msgr2=0x7f6ba00c1890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:18.899 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:18.897+0000 7f6ba53ed700 1 --2- 172.21.15.86:0/398459239 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6ba00aaf60 0x7f6ba00c1890 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f6b94011aa0 tx=0x7f6b94011db0 comp rx=0 tx=0).stop 2023-03-06T13:49:18.899 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:18.897+0000 7f6ba53ed700 1 -- 172.21.15.86:0/398459239 shutdown_connections 2023-03-06T13:49:18.900 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:18.897+0000 7f6ba53ed700 1 --2- 172.21.15.86:0/398459239 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7f6b8c0682f0 0x7f6b8c06a7a0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:18.900 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:18.897+0000 7f6ba53ed700 1 --2- 172.21.15.86:0/398459239 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f6ba00a93f0 0x7f6ba01e80b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:18.900 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:18.897+0000 7f6ba53ed700 1 --2- 172.21.15.86:0/398459239 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f6b88004d90 0x7f6ba01e5fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:18.900 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:18.897+0000 7f6ba53ed700 1 --2- 172.21.15.86:0/398459239 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6ba00aaf60 0x7f6ba00c1890 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:18.900 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:18.897+0000 7f6ba53ed700 1 -- 172.21.15.86:0/398459239 >> 172.21.15.86:0/398459239 conn(0x7f6ba00a6f40 msgr2=0x7f6ba00a5a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T13:49:18.900 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:18.897+0000 7f6ba53ed700 1 -- 172.21.15.86:0/398459239 shutdown_connections 2023-03-06T13:49:18.901 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:18.897+0000 7f6ba53ed700 1 -- 172.21.15.86:0/398459239 wait complete. 2023-03-06T13:49:18.911 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-03-06T13:49:18.912 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-03-06T13:49:19.031 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.029+0000 7f71e05cd700 1 Processor -- start 2023-03-06T13:49:19.031 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.029+0000 7f71e05cd700 1 -- start start 2023-03-06T13:49:19.033 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.030+0000 7f71e05cd700 1 --2- >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f71d8149420 0x7f71d80c2860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:19.033 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.030+0000 7f71e05cd700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f71d80c2da0 0x7f71d814f0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:19.033 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.030+0000 7f71e05cd700 1 -- --> v1:172.21.15.202:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71d8153340 con 0x7f71d806ea90 2023-03-06T13:49:19.033 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.030+0000 7f71e05cd700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71d81497f0 con 0x7f71d80c2da0 2023-03-06T13:49:19.033 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.030+0000 7f71e05cd700 1 -- --> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71d8152750 con 0x7f71d8149420 2023-03-06T13:49:19.033 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.030+0000 7f71ddb68700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f71d80c2da0 0x7f71d814f0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:19.034 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.030+0000 7f71ddb68700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f71d80c2da0 0x7f71d814f0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:38716/0 (socket says 172.21.15.86:38716) 2023-03-06T13:49:19.034 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.030+0000 7f71ddb68700 1 -- 172.21.15.86:0/166871472 learned_addr learned my addr 172.21.15.86:0/166871472 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-03-06T13:49:19.034 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.030+0000 7f71de369700 1 --2- 172.21.15.86:0/166871472 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f71d8149420 0x7f71d80c2860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:19.034 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.031+0000 7f71ddb68700 1 -- 172.21.15.86:0/166871472 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f71d8149420 msgr2=0x7f71d80c2860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T13:49:19.034 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.031+0000 7f71ddb68700 1 --2- 172.21.15.86:0/166871472 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f71d8149420 0x7f71d80c2860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:19.034 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.031+0000 7f71ddb68700 1 -- 172.21.15.86:0/166871472 >> v1:172.21.15.202:6789/0 conn(0x7f71d806ea90 legacy=0x7f71d806a330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:19.034 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.031+0000 7f71ddb68700 1 -- 172.21.15.86:0/166871472 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71d8152a10 con 0x7f71d80c2da0 2023-03-06T13:49:19.035 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.031+0000 7f71ddb68700 1 --2- 172.21.15.86:0/166871472 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f71d80c2da0 0x7f71d814f0c0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f71d40098f0 tx=0x7f71d4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e259619f2af1f47 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T13:49:19.035 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.031+0000 7f71dd367700 1 -- 172.21.15.86:0/166871472 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71d4011830 con 0x7f71d80c2da0 2023-03-06T13:49:19.035 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.031+0000 7f71dd367700 1 -- 172.21.15.86:0/166871472 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71d4011990 con 0x7f71d80c2da0 2023-03-06T13:49:19.035 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.031+0000 7f71dd367700 1 -- 172.21.15.86:0/166871472 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71d4011d20 con 0x7f71d80c2da0 2023-03-06T13:49:19.037 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.031+0000 7f71e05cd700 1 -- 172.21.15.86:0/166871472 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f71d80c2da0 msgr2=0x7f71d814f0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:19.037 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.031+0000 7f71e05cd700 1 --2- 172.21.15.86:0/166871472 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f71d80c2da0 0x7f71d814f0c0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f71d40098f0 tx=0x7f71d4009c00 comp rx=0 tx=0).stop 2023-03-06T13:49:19.038 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.032+0000 7f71e05cd700 1 -- 172.21.15.86:0/166871472 shutdown_connections 2023-03-06T13:49:19.038 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.032+0000 7f71e05cd700 1 --2- 172.21.15.86:0/166871472 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f71d8149420 0x7f71d80c2860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:19.038 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.032+0000 7f71e05cd700 1 --2- 172.21.15.86:0/166871472 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f71d80c2da0 0x7f71d814f0c0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:19.038 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.032+0000 7f71e05cd700 1 -- 172.21.15.86:0/166871472 >> 172.21.15.86:0/166871472 conn(0x7f71d806c0d0 msgr2=0x7f71d80c2150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T13:49:19.038 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.032+0000 7f71e05cd700 1 -- 172.21.15.86:0/166871472 shutdown_connections 2023-03-06T13:49:19.038 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.032+0000 7f71e05cd700 1 -- 172.21.15.86:0/166871472 wait complete. 2023-03-06T13:49:19.039 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.033+0000 7f71e05cd700 1 Processor -- start 2023-03-06T13:49:19.039 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.033+0000 7f71e05cd700 1 -- start start 2023-03-06T13:49:19.040 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.033+0000 7f71e05cd700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f71d806ea90 0x7f71d81e8610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:19.040 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.033+0000 7f71e05cd700 1 --2- >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f71d80c2da0 0x7f71d8144a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:19.040 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.033+0000 7f71e05cd700 1 --2- >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f71d8149420 0x7f71d814a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:19.040 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.033+0000 7f71e05cd700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71d81e9160 con 0x7f71d806ea90 2023-03-06T13:49:19.040 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.033+0000 7f71e05cd700 1 -- --> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71d814c320 con 0x7f71d80c2da0 2023-03-06T13:49:19.040 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.033+0000 7f71e05cd700 1 -- --> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71d80a80b0 con 0x7f71d8149420 2023-03-06T13:49:19.040 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.033+0000 7f71de369700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f71d806ea90 0x7f71d81e8610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:19.041 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.033+0000 7f71de369700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f71d806ea90 0x7f71d81e8610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:38722/0 (socket says 172.21.15.86:38722) 2023-03-06T13:49:19.041 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.033+0000 7f71de369700 1 -- 172.21.15.86:0/3934378028 learned_addr learned my addr 172.21.15.86:0/3934378028 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-03-06T13:49:19.041 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.033+0000 7f71ddb68700 1 --2- 172.21.15.86:0/3934378028 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f71d80c2da0 0x7f71d8144a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:19.041 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.033+0000 7f71deb6a700 1 --2- 172.21.15.86:0/3934378028 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f71d8149420 0x7f71d814a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:19.041 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.034+0000 7f71de369700 1 -- 172.21.15.86:0/3934378028 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f71d8149420 msgr2=0x7f71d814a3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:19.041 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.034+0000 7f71de369700 1 --2- 172.21.15.86:0/3934378028 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f71d8149420 0x7f71d814a3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:19.041 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.034+0000 7f71de369700 1 -- 172.21.15.86:0/3934378028 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f71d80c2da0 msgr2=0x7f71d8144a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:19.042 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.034+0000 7f71de369700 1 --2- 172.21.15.86:0/3934378028 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f71d80c2da0 0x7f71d8144a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:19.042 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.034+0000 7f71de369700 1 -- 172.21.15.86:0/3934378028 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71d4009550 con 0x7f71d806ea90 2023-03-06T13:49:19.042 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.034+0000 7f71de369700 1 --2- 172.21.15.86:0/3934378028 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f71d806ea90 0x7f71d81e8610 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f71c800ea10 tx=0x7f71c800ed20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T13:49:19.042 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.034+0000 7f71ceffd700 1 -- 172.21.15.86:0/3934378028 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71c8009710 con 0x7f71d806ea90 2023-03-06T13:49:19.042 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.034+0000 7f71ceffd700 1 -- 172.21.15.86:0/3934378028 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71c800c850 con 0x7f71d806ea90 2023-03-06T13:49:19.042 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.034+0000 7f71e05cd700 1 -- 172.21.15.86:0/3934378028 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71d8152fd0 con 0x7f71d806ea90 2023-03-06T13:49:19.042 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.034+0000 7f71ceffd700 1 -- 172.21.15.86:0/3934378028 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71c800cbc0 con 0x7f71d806ea90 2023-03-06T13:49:19.043 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.034+0000 7f71e05cd700 1 -- 172.21.15.86:0/3934378028 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71d8152cf0 con 0x7f71d806ea90 2023-03-06T13:49:19.043 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.035+0000 7f71e05cd700 1 -- 172.21.15.86:0/3934378028 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71d81e8c10 con 0x7f71d806ea90 2023-03-06T13:49:19.043 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.036+0000 7f71ceffd700 1 -- 172.21.15.86:0/3934378028 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f71c8019030 con 0x7f71d806ea90 2023-03-06T13:49:19.044 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.036+0000 7f71ceffd700 1 --2- 172.21.15.86:0/3934378028 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7f71bc0682f0 0x7f71bc06a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:19.044 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.036+0000 7f71ceffd700 1 -- 172.21.15.86:0/3934378028 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f71c80863f0 con 0x7f71d806ea90 2023-03-06T13:49:19.044 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.036+0000 7f71ddb68700 1 --2- 172.21.15.86:0/3934378028 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7f71bc0682f0 0x7f71bc06a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:19.044 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.037+0000 7f71ddb68700 1 --2- 172.21.15.86:0/3934378028 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7f71bc0682f0 0x7f71bc06a7a0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f71d80c31b0 tx=0x7f71d4008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T13:49:19.044 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.040+0000 7f71ceffd700 1 -- 172.21.15.86:0/3934378028 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f71c8052be0 con 0x7f71d806ea90 2023-03-06T13:49:19.224 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.222+0000 7f71e05cd700 1 -- 172.21.15.86:0/3934378028 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f71d804e750 con 0x7f71d806ea90 2023-03-06T13:49:19.225 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.224+0000 7f71ceffd700 1 -- 172.21.15.86:0/3934378028 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+17811 (secure 0 0 0) 0x7f71c8056200 con 0x7f71d806ea90 2023-03-06T13:49:19.226 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-03-06T13:49:19.226 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":23,"fsid":"2cca6c77-50cb-47d8-a8c7-444575d01327","created":"2023-03-06T13:48:48.337369+0000","modified":"2023-03-06T13:49:14.708570+0000","last_up_change":"2023-03-06T13:48:59.782729+0000","last_in_change":"2023-03-06T13:48:50.777249+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-03-06T13:48:59.879087+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-03-06T13:49:06.686394+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-03-06T13:49:11.362997+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-03-06T13:49:12.753969+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2de68e69-e10f-49e1-a15a-8a9bfff504c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":96739},{"type":"v1","addr":"172.21.15.86:6816","nonce":96739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":96739},{"type":"v1","addr":"172.21.15.86:6819","nonce":96739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":96739},{"type":"v1","addr":"172.21.15.86:6823","nonce":96739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":96739},{"type":"v1","addr":"172.21.15.86:6821","nonce":96739}]},"public_addr":"172.21.15.86:6816/96739","cluster_addr":"172.21.15.86:6819/96739","heartbeat_back_addr":"172.21.15.86:6823/96739","heartbeat_front_addr":"172.21.15.86:6821/96739","state":["exists","up"]},{"osd":1,"uuid":"3e75c061-0de5-4742-a20d-4b5a4adb9b81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":96738},{"type":"v1","addr":"172.21.15.86:6801","nonce":96738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":96738},{"type":"v1","addr":"172.21.15.86:6803","nonce":96738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":96738},{"type":"v1","addr":"172.21.15.86:6807","nonce":96738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":96738},{"type":"v1","addr":"172.21.15.86:6805","nonce":96738}]},"public_addr":"172.21.15.86:6801/96738","cluster_addr":"172.21.15.86:6803/96738","heartbeat_back_addr":"172.21.15.86:6807/96738","heartbeat_front_addr":"172.21.15.86:6805/96738","state":["exists","up"]},{"osd":2,"uuid":"38d71bce-81c2-4e33-91e1-65efb08f2291","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":96740},{"type":"v1","addr":"172.21.15.86:6809","nonce":96740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":96740},{"type":"v1","addr":"172.21.15.86:6811","nonce":96740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6815","nonce":96740},{"type":"v1","addr":"172.21.15.86:6817","nonce":96740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":96740},{"type":"v1","addr":"172.21.15.86:6813","nonce":96740}]},"public_addr":"172.21.15.86:6809/96740","cluster_addr":"172.21.15.86:6811/96740","heartbeat_back_addr":"172.21.15.86:6817/96740","heartbeat_front_addr":"172.21.15.86:6813/96740","state":["exists","up"]},{"osd":3,"uuid":"d95a2686-21bd-4b66-9ea5-eef65403935b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":96756},{"type":"v1","addr":"172.21.15.86:6825","nonce":96756}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":96756},{"type":"v1","addr":"172.21.15.86:6827","nonce":96756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":96756},{"type":"v1","addr":"172.21.15.86:6831","nonce":96756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":96756},{"type":"v1","addr":"172.21.15.86:6829","nonce":96756}]},"public_addr":"172.21.15.86:6825/96756","cluster_addr":"172.21.15.86:6827/96756","heartbeat_back_addr":"172.21.15.86:6831/96756","heartbeat_front_addr":"172.21.15.86:6829/96756","state":["exists","up"]},{"osd":4,"uuid":"98c7e359-0f00-496a-8aaa-5472af355e48","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.202:6816","nonce":96847},{"type":"v1","addr":"172.21.15.202:6817","nonce":96847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.202:6818","nonce":96847},{"type":"v1","addr":"172.21.15.202:6819","nonce":96847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.202:6822","nonce":96847},{"type":"v1","addr":"172.21.15.202:6823","nonce":96847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.202:6820","nonce":96847},{"type":"v1","addr":"172.21.15.202:6821","nonce":96847}]},"public_addr":"172.21.15.202:6817/96847","cluster_addr":"172.21.15.202:6819/96847","heartbeat_back_addr":"172.21.15.202:6823/96847","heartbeat_front_addr":"172.21.15.202:6821/96847","state":["exists","up"]},{"osd":5,"uuid":"fa6688d9-73f3-4593-a50e-d96a0fe5f4cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.202:6824","nonce":96848},{"type":"v1","addr":"172.21.15.202:6825","nonce":96848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.202:6826","nonce":96848},{"type":"v1","addr":"172.21.15.202:6827","nonce":96848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.202:6830","nonce":96848},{"type":"v1","addr":"172.21.15.202:6831","nonce":96848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.202:6828","nonce":96848},{"type":"v1","addr":"172.21.15.202:6829","nonce":96848}]},"public_addr":"172.21.15.202:6825/96848","cluster_addr":"172.21.15.202:6827/96848","heartbeat_back_addr":"172.21.15.202:6831/96848","heartbeat_front_addr":"172.21.15.202:6829/96848","state":["exists","up"]},{"osd":6,"uuid":"7bfc6dc0-2388-4498-9cd7-766e3606f6a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.202:6808","nonce":96845},{"type":"v1","addr":"172.21.15.202:6809","nonce":96845}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.202:6810","nonce":96845},{"type":"v1","addr":"172.21.15.202:6811","nonce":96845}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.202:6814","nonce":96845},{"type":"v1","addr":"172.21.15.202:6815","nonce":96845}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.202:6812","nonce":96845},{"type":"v1","addr":"172.21.15.202:6813","nonce":96845}]},"public_addr":"172.21.15.202:6809/96845","cluster_addr":"172.21.15.202:6811/96845","heartbeat_back_addr":"172.21.15.202:6815/96845","heartbeat_front_addr":"172.21.15.202:6813/96845","state":["exists","up"]},{"osd":7,"uuid":"c475f863-96fd-48e3-8033-7d1c3b1d503f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.202:6800","nonce":96846},{"type":"v1","addr":"172.21.15.202:6801","nonce":96846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.202:6802","nonce":96846},{"type":"v1","addr":"172.21.15.202:6803","nonce":96846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.202:6806","nonce":96846},{"type":"v1","addr":"172.21.15.202:6807","nonce":96846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.202:6804","nonce":96846},{"type":"v1","addr":"172.21.15.202:6805","nonce":96846}]},"public_addr":"172.21.15.202:6801/96846","cluster_addr":"172.21.15.202:6803/96846","heartbeat_back_addr":"172.21.15.202:6807/96846","heartbeat_front_addr":"172.21.15.202:6805/96846","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-06T13:48:55.997991+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-06T13:48:55.930805+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-06T13:48:56.000312+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-06T13:48:55.998360+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-06T13:48:56.052762+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-06T13:48:56.036049+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-06T13:48:56.048751+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-06T13:48:56.011928+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-03-06T13:49:19.227 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.225+0000 7f71e05cd700 1 -- 172.21.15.86:0/3934378028 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7f71bc0682f0 msgr2=0x7f71bc06a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:19.228 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.225+0000 7f71e05cd700 1 --2- 172.21.15.86:0/3934378028 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7f71bc0682f0 0x7f71bc06a7a0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f71d80c31b0 tx=0x7f71d4008030 comp rx=0 tx=0).stop 2023-03-06T13:49:19.228 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.225+0000 7f71e05cd700 1 -- 172.21.15.86:0/3934378028 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f71d806ea90 msgr2=0x7f71d81e8610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:19.228 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.225+0000 7f71e05cd700 1 --2- 172.21.15.86:0/3934378028 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f71d806ea90 0x7f71d81e8610 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f71c800ea10 tx=0x7f71c800ed20 comp rx=0 tx=0).stop 2023-03-06T13:49:19.228 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.225+0000 7f71e05cd700 1 -- 172.21.15.86:0/3934378028 shutdown_connections 2023-03-06T13:49:19.228 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.225+0000 7f71e05cd700 1 --2- 172.21.15.86:0/3934378028 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7f71bc0682f0 0x7f71bc06a7a0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:19.228 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.226+0000 7f71e05cd700 1 --2- 172.21.15.86:0/3934378028 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f71d806ea90 0x7f71d81e8610 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:19.228 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.226+0000 7f71e05cd700 1 --2- 172.21.15.86:0/3934378028 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f71d8149420 0x7f71d814a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:19.229 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.226+0000 7f71e05cd700 1 --2- 172.21.15.86:0/3934378028 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f71d80c2da0 0x7f71d8144a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:19.229 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.226+0000 7f71e05cd700 1 -- 172.21.15.86:0/3934378028 >> 172.21.15.86:0/3934378028 conn(0x7f71d806c0d0 msgr2=0x7f71d81470c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T13:49:19.229 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.226+0000 7f71e05cd700 1 -- 172.21.15.86:0/3934378028 shutdown_connections 2023-03-06T13:49:19.229 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.226+0000 7f71e05cd700 1 -- 172.21.15.86:0/3934378028 wait complete. 2023-03-06T13:49:19.240 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-03-06T13:49:19.240 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-03-06T13:49:19.241 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-03-06T13:49:19.241 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-03-06T13:49:19.242 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-03-06T13:49:19.242 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-03-06T13:49:19.243 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-03-06T13:49:19.243 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-03-06T13:49:19.431 INFO:tasks.ceph.mds.b.smithi202.stderr:2023-03-06T13:49:19.429+0000 7f6235d67700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-03-06T13:49:19.454 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.452+0000 7fe0884b2700 1 Processor -- start 2023-03-06T13:49:19.455 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.452+0000 7fe0884b2700 1 -- start start 2023-03-06T13:49:19.455 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.453+0000 7fe0884b2700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fe0800bad50 0x7fe080153560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:19.455 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.453+0000 7fe0884b2700 1 --2- >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fe0800bb9d0 0x7fe0800bc2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:19.456 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.453+0000 7fe0884b2700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0800b81f0 con 0x7fe0800a6e80 2023-03-06T13:49:19.456 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.453+0000 7fe0884b2700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0800bc800 con 0x7fe0800bad50 2023-03-06T13:49:19.456 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.453+0000 7fe0884b2700 1 -- --> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0800b7f10 con 0x7fe0800bb9d0 2023-03-06T13:49:19.456 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.454+0000 7f42cb705700 1 Processor -- start 2023-03-06T13:49:19.457 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.454+0000 7fe08624e700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fe0800bad50 0x7fe080153560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:19.457 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.454+0000 7fe086a4f700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7fe0800a6e80 0x7fe0800c1760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:48882/0 (socket says 172.21.15.86:48882) 2023-03-06T13:49:19.457 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.454+0000 7fe086a4f700 1 -- 172.21.15.86:0/2187504111 learned_addr learned my addr 172.21.15.86:0/2187504111 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-03-06T13:49:19.457 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.454+0000 7fe08524c700 1 -- 172.21.15.86:0/2187504111 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2644562243 0 0) 0x7fe0800b81f0 con 0x7fe0800a6e80 2023-03-06T13:49:19.458 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.454+0000 7fe08524c700 1 -- 172.21.15.86:0/2187504111 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe06c0035b0 con 0x7fe0800a6e80 2023-03-06T13:49:19.458 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.454+0000 7fe08624e700 1 -- 172.21.15.86:0/2187504111 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fe0800bb9d0 msgr2=0x7fe0800bc2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T13:49:19.458 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.454+0000 7fe08624e700 1 --2- 172.21.15.86:0/2187504111 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fe0800bb9d0 0x7fe0800bc2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:19.458 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.454+0000 7fe08624e700 1 -- 172.21.15.86:0/2187504111 >> v1:172.21.15.86:6789/0 conn(0x7fe0800a6e80 legacy=0x7fe0800c1760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:19.458 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.454+0000 7fe08624e700 1 -- 172.21.15.86:0/2187504111 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0800b6310 con 0x7fe0800bad50 2023-03-06T13:49:19.458 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.454+0000 7fe08624e700 1 --2- 172.21.15.86:0/2187504111 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe0800bad50 0x7fe080153560 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fe07c009840 tx=0x7fe07c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d11905103eee289 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T13:49:19.458 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.455+0000 7fe08524c700 1 -- 172.21.15.86:0/2187504111 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe07c011830 con 0x7fe0800bad50 2023-03-06T13:49:19.458 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.455+0000 7fe08524c700 1 -- 172.21.15.86:0/2187504111 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe07c011990 con 0x7fe0800bad50 2023-03-06T13:49:19.459 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.455+0000 7fe08524c700 1 -- 172.21.15.86:0/2187504111 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe07c011d20 con 0x7fe0800bad50 2023-03-06T13:49:19.459 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.454+0000 7f42cb705700 1 -- start start 2023-03-06T13:49:19.459 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.455+0000 7f42cb705700 1 --2- >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f42c40c2270 0x7f42c40bc530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:19.460 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.455+0000 7f42cb705700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42c40bf6f0 con 0x7f42c415c1d0 2023-03-06T13:49:19.460 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.455+0000 7f42cb705700 1 -- --> v1:172.21.15.202:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42c406b850 con 0x7f42c406ad10 2023-03-06T13:49:19.460 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.455+0000 7f42cb705700 1 -- --> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42c406baf0 con 0x7f42c40c2270 2023-03-06T13:49:19.460 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.455+0000 7f42c9ca2700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f42c415c1d0 0x7f42c415e5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:48888/0 (socket says 172.21.15.86:48888) 2023-03-06T13:49:19.460 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.455+0000 7f42c9ca2700 1 -- 172.21.15.86:0/2544310656 learned_addr learned my addr 172.21.15.86:0/2544310656 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-03-06T13:49:19.460 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.455+0000 7f42bbfff700 1 -- 172.21.15.86:0/2544310656 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2762777708 0 0) 0x7f42c40bf6f0 con 0x7f42c415c1d0 2023-03-06T13:49:19.460 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.455+0000 7f42bbfff700 1 -- 172.21.15.86:0/2544310656 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f42b00035b0 con 0x7f42c415c1d0 2023-03-06T13:49:19.461 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.456+0000 7fe0884b2700 1 -- 172.21.15.86:0/2187504111 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe0800bad50 msgr2=0x7fe080153560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:19.461 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.456+0000 7fe0884b2700 1 --2- 172.21.15.86:0/2187504111 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe0800bad50 0x7fe080153560 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fe07c009840 tx=0x7fe07c009b50 comp rx=0 tx=0).stop 2023-03-06T13:49:19.461 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.456+0000 7f42c94a1700 1 --2- 172.21.15.86:0/2544310656 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f42c40c2270 0x7f42c40bc530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:19.462 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.456+0000 7f42bbfff700 1 -- 172.21.15.86:0/2544310656 <== mon.0 v1:172.21.15.86:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4085373159 0 0) 0x7f42b00035b0 con 0x7f42c415c1d0 2023-03-06T13:49:19.462 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.456+0000 7f42bbfff700 1 -- 172.21.15.86:0/2544310656 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f42c40c2270 msgr2=0x7f42c40bc530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T13:49:19.462 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.456+0000 7f42bbfff700 1 --2- 172.21.15.86:0/2544310656 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f42c40c2270 0x7f42c40bc530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:19.462 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.456+0000 7f42bbfff700 1 -- 172.21.15.86:0/2544310656 >> v1:172.21.15.202:6789/0 conn(0x7f42c406ad10 legacy=0x7f42c41575a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T13:49:19.462 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.456+0000 7f42bbfff700 1 -- 172.21.15.86:0/2544310656 --> v1:172.21.15.86:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42c406e360 con 0x7f42c415c1d0 2023-03-06T13:49:19.462 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.456+0000 7f42bbfff700 1 -- 172.21.15.86:0/2544310656 <== mon.0 v1:172.21.15.86:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2191261126 0 0) 0x7f42b4001670 con 0x7f42c415c1d0 2023-03-06T13:49:19.462 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.456+0000 7f42bbfff700 1 -- 172.21.15.86:0/2544310656 >> v1:172.21.15.86:6789/0 conn(0x7f42c415c1d0 legacy=0x7f42c415e5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:19.463 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.456+0000 7f42bbfff700 1 --2- 172.21.15.86:0/2544310656 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f42b0003aa0 0x7f42b0003e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:19.463 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.456+0000 7f42bbfff700 1 --2- 172.21.15.86:0/2544310656 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f42b0004850 0x7f42b0004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:19.463 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.456+0000 7f42bbfff700 1 --2- 172.21.15.86:0/2544310656 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f42b0005450 0x7f42b000ba70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:19.463 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.456+0000 7f42bbfff700 1 -- 172.21.15.86:0/2544310656 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42c406baf0 con 0x7f42b0004850 2023-03-06T13:49:19.463 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.456+0000 7f42bbfff700 1 -- 172.21.15.86:0/2544310656 --> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42b000c300 con 0x7f42b0003aa0 2023-03-06T13:49:19.463 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.456+0000 7f42bbfff700 1 -- 172.21.15.86:0/2544310656 --> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42b000c4c0 con 0x7f42b0005450 2023-03-06T13:49:19.463 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.456+0000 7f42c8ca0700 1 --2- 172.21.15.86:0/2544310656 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f42b0004850 0x7f42b0004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:19.464 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.456+0000 7f42c94a1700 1 --2- 172.21.15.86:0/2544310656 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f42b0003aa0 0x7f42b0003e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:19.464 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.456+0000 7f42c9ca2700 1 --2- 172.21.15.86:0/2544310656 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f42b0005450 0x7f42b000ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:19.464 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.456+0000 7fe0884b2700 1 -- 172.21.15.86:0/2187504111 shutdown_connections 2023-03-06T13:49:19.464 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.456+0000 7fe0884b2700 1 --2- 172.21.15.86:0/2187504111 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe0800bad50 0x7fe080153560 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:19.464 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.456+0000 7fe0884b2700 1 --2- 172.21.15.86:0/2187504111 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fe0800bb9d0 0x7fe0800bc2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:19.464 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.456+0000 7fe0884b2700 1 -- 172.21.15.86:0/2187504111 >> 172.21.15.86:0/2187504111 conn(0x7fe08006afc0 msgr2=0x7fe0800c1050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T13:49:19.465 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.456+0000 7f42c8ca0700 1 -- 172.21.15.86:0/2544310656 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f42b0005450 msgr2=0x7f42b000ba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T13:49:19.465 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.456+0000 7f42c8ca0700 1 --2- 172.21.15.86:0/2544310656 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f42b0005450 0x7f42b000ba70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:19.466 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.456+0000 7f42c8ca0700 1 -- 172.21.15.86:0/2544310656 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f42b0003aa0 msgr2=0x7f42b0003e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T13:49:19.466 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.456+0000 7f42c8ca0700 1 --2- 172.21.15.86:0/2544310656 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f42b0003aa0 0x7f42b0003e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:19.466 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.456+0000 7f42c8ca0700 1 -- 172.21.15.86:0/2544310656 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42c406e360 con 0x7f42b0004850 2023-03-06T13:49:19.466 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.457+0000 7f42c94a1700 1 --2- 172.21.15.86:0/2544310656 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f42b0003aa0 0x7f42b0003e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-06T13:49:19.466 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.457+0000 7f42c8ca0700 1 --2- 172.21.15.86:0/2544310656 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f42b0004850 0x7f42b0004cc0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f42bc0049f0 tx=0x7f42b0005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d91d85685dd078e7 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T13:49:19.466 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.457+0000 7f42bbfff700 1 -- 172.21.15.86:0/2544310656 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42bc00cc20 con 0x7f42b0004850 2023-03-06T13:49:19.466 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.457+0000 7f42bbfff700 1 -- 172.21.15.86:0/2544310656 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42bc00cd80 con 0x7f42b0004850 2023-03-06T13:49:19.467 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.457+0000 7f42bbfff700 1 -- 172.21.15.86:0/2544310656 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42bc012640 con 0x7f42b0004850 2023-03-06T13:49:19.467 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.457+0000 7fe0884b2700 1 -- 172.21.15.86:0/2187504111 shutdown_connections 2023-03-06T13:49:19.467 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.457+0000 7fd4a0fd8700 1 Processor -- start 2023-03-06T13:49:19.467 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.458+0000 7fd4a0fd8700 1 -- start start 2023-03-06T13:49:19.468 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.456+0000 7ff3a1ea1700 1 Processor -- start 2023-03-06T13:49:19.468 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.456+0000 7ff3a1ea1700 1 -- start start 2023-03-06T13:49:19.468 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.457+0000 7ff3a1ea1700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7ff39c0c19d0 0x7ff39c0b8c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:19.468 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.457+0000 7ff3a1ea1700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff39c0bc6f0 con 0x7ff39c0bc1f0 2023-03-06T13:49:19.468 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.457+0000 7ff3a1ea1700 1 -- --> v1:172.21.15.202:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff39c0b6920 con 0x7ff39c06cfb0 2023-03-06T13:49:19.469 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.457+0000 7ff3a1ea1700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff39c0bc9d0 con 0x7ff39c0c19d0 2023-03-06T13:49:19.469 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.457+0000 7ff39b7fe700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7ff39c0c19d0 0x7ff39c0b8c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:19.469 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.457+0000 7ff39b7fe700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7ff39c0c19d0 0x7ff39c0b8c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:38754/0 (socket says 172.21.15.86:38754) 2023-03-06T13:49:19.469 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.457+0000 7ff39b7fe700 1 -- 172.21.15.86:0/3368831925 learned_addr learned my addr 172.21.15.86:0/3368831925 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-03-06T13:49:19.469 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.458+0000 7ff39a7fc700 1 -- 172.21.15.86:0/3368831925 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4144960459 0 0) 0x7ff39c0bc6f0 con 0x7ff39c0bc1f0 2023-03-06T13:49:19.469 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.458+0000 7ff39a7fc700 1 -- 172.21.15.86:0/3368831925 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff384003590 con 0x7ff39c0bc1f0 2023-03-06T13:49:19.470 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.455+0000 7f6bf4e89700 1 Processor -- start 2023-03-06T13:49:19.470 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.455+0000 7f6bf4e89700 1 -- start start 2023-03-06T13:49:19.470 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.456+0000 7f6bf4e89700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f6bf015fdb0 0x7f6bf0167970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:19.470 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.456+0000 7f6bf4e89700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6bf00b9310 con 0x7f6bf00c19d0 2023-03-06T13:49:19.470 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.456+0000 7f6bf4e89700 1 -- --> v1:172.21.15.202:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6bf00bc6f0 con 0x7f6bf00bc1f0 2023-03-06T13:49:19.470 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.456+0000 7f6bf4e89700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6bf00bc9d0 con 0x7f6bf015fdb0 2023-03-06T13:49:19.470 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.457+0000 7f6bedd9b700 1 --1- >> v1:172.21.15.202:6789/0 conn(0x7f6bf00bc1f0 0x7f6bf015f6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.202:6789/0 says I am v1:172.21.15.86:47952/0 (socket says 172.21.15.86:47952) 2023-03-06T13:49:19.471 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.457+0000 7f6bedd9b700 1 -- 172.21.15.86:0/978691366 learned_addr learned my addr 172.21.15.86:0/978691366 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-03-06T13:49:19.471 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.457+0000 7f6beed9d700 1 --2- 172.21.15.86:0/978691366 >> v2:172.21.15.86:3300/0 conn(0x7f6bf015fdb0 0x7f6bf0167970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:19.471 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.458+0000 7f42cb705700 1 -- 172.21.15.86:0/2544310656 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f42b0004850 msgr2=0x7f42b0004cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:19.471 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.458+0000 7f42cb705700 1 --2- 172.21.15.86:0/2544310656 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f42b0004850 0x7f42b0004cc0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f42bc0049f0 tx=0x7f42b0005880 comp rx=0 tx=0).stop 2023-03-06T13:49:19.471 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.458+0000 7fe0884b2700 1 -- 172.21.15.86:0/2187504111 wait complete. 2023-03-06T13:49:19.472 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.457+0000 7f6bed59a700 1 -- 172.21.15.86:0/978691366 <== mon.1 v1:172.21.15.202:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2026778223 0 0) 0x7f6bf00bc6f0 con 0x7f6bf00bc1f0 2023-03-06T13:49:19.472 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.458+0000 7f6bed59a700 1 -- 172.21.15.86:0/978691366 --> v1:172.21.15.202:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6bd80035b0 con 0x7f6bf00bc1f0 2023-03-06T13:49:19.472 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.458+0000 7f6bed59a700 1 -- 172.21.15.86:0/978691366 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1691876949 0 0) 0x7f6bf00b9310 con 0x7f6bf00c19d0 2023-03-06T13:49:19.472 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.458+0000 7f6bed59a700 1 -- 172.21.15.86:0/978691366 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6bf00bc6f0 con 0x7f6bf00c19d0 2023-03-06T13:49:19.473 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.458+0000 7ff39b7fe700 1 -- 172.21.15.86:0/3368831925 >> v1:172.21.15.202:6789/0 conn(0x7ff39c06cfb0 legacy=0x7ff39c166960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:19.473 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.458+0000 7ff39b7fe700 1 -- 172.21.15.86:0/3368831925 >> v1:172.21.15.86:6789/0 conn(0x7ff39c0bc1f0 legacy=0x7ff39c06c8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:19.473 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.458+0000 7ff39b7fe700 1 -- 172.21.15.86:0/3368831925 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff39c0b6c00 con 0x7ff39c0c19d0 2023-03-06T13:49:19.473 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.459+0000 7ff39b7fe700 1 --2- 172.21.15.86:0/3368831925 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff39c0c19d0 0x7ff39c0b8c00 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7ff394007730 tx=0x7ff39400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b276a3ba4c1d743 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T13:49:19.473 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.459+0000 7fd4a0fd8700 1 --2- >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fd49c149700 0x7fd49c0a6f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:19.474 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.459+0000 7fd4a0fd8700 1 --2- >> v2:172.21.15.202:3300/0 conn(0x7fd49c0a7450 0x7fd49c1507d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:19.474 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.459+0000 7fd4a0fd8700 1 -- --> v1:172.21.15.202:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd49c152720 con 0x7fd49c0c11f0 2023-03-06T13:49:19.474 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.459+0000 7fd4a0fd8700 1 -- --> v2:172.21.15.202:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd49c0c2e10 con 0x7fd49c0a7450 2023-03-06T13:49:19.474 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.459+0000 7fd4a0fd8700 1 -- --> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd49c153580 con 0x7fd49c149700 2023-03-06T13:49:19.474 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.459+0000 7ff39a7fc700 1 -- 172.21.15.86:0/3368831925 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff39400e070 con 0x7ff39c0c19d0 2023-03-06T13:49:19.475 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.459+0000 7ff39a7fc700 1 -- 172.21.15.86:0/3368831925 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3940092e0 con 0x7ff39c0c19d0 2023-03-06T13:49:19.475 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.459+0000 7ff39a7fc700 1 -- 172.21.15.86:0/3368831925 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff390001670 con 0x7ff39c0c19d0 2023-03-06T13:49:19.475 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.458+0000 7f42c9ca2700 1 -- 172.21.15.86:0/2544310656 reap_dead start 2023-03-06T13:49:19.475 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.459+0000 7f42cb705700 1 -- 172.21.15.86:0/2544310656 shutdown_connections 2023-03-06T13:49:19.476 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.459+0000 7f42cb705700 1 -- 172.21.15.86:0/2544310656 >> 172.21.15.86:0/2544310656 conn(0x7f42c40a4180 msgr2=0x7f42c40c18f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T13:49:19.476 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.459+0000 7fd49a59c700 1 --2- >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fd49c149700 0x7fd49c0a6f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:19.476 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.459+0000 7fd49a59c700 1 --2- >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fd49c149700 0x7fd49c0a6f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.202:3301/0 says I am v2:172.21.15.86:50456/0 (socket says 172.21.15.86:50456) 2023-03-06T13:49:19.476 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.459+0000 7fd49a59c700 1 -- 172.21.15.86:0/2214309197 learned_addr learned my addr 172.21.15.86:0/2214309197 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-03-06T13:49:19.477 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.459+0000 7f6beed9d700 1 -- 172.21.15.86:0/978691366 >> v1:172.21.15.202:6789/0 conn(0x7f6bf00bc1f0 legacy=0x7f6bf015f6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:19.477 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.459+0000 7f6beed9d700 1 -- 172.21.15.86:0/978691366 >> v1:172.21.15.86:6789/0 conn(0x7f6bf00c19d0 legacy=0x7f6bf00b8c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:19.477 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.459+0000 7f0f94d51700 1 Processor -- start 2023-03-06T13:49:19.477 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.459+0000 7f6beed9d700 1 -- 172.21.15.86:0/978691366 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bf00b6920 con 0x7f6bf015fdb0 2023-03-06T13:49:19.478 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.460+0000 7fd499d9b700 1 --2- 172.21.15.86:0/2214309197 >> v2:172.21.15.202:3300/0 conn(0x7fd49c0a7450 0x7fd49c1507d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:19.478 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.460+0000 7f6beed9d700 1 --2- 172.21.15.86:0/978691366 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6bf015fdb0 0x7f6bf0167970 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f6be800b370 tx=0x7f6be800bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46304063fae71780 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T13:49:19.478 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.460+0000 7fdb86d9c700 1 Processor -- start 2023-03-06T13:49:19.479 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.460+0000 7fe0884b2700 1 Processor -- start 2023-03-06T13:49:19.479 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.460+0000 7f42cb705700 1 -- 172.21.15.86:0/2544310656 shutdown_connections 2023-03-06T13:49:19.479 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.460+0000 7fe0884b2700 1 -- start start 2023-03-06T13:49:19.480 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.460+0000 7f6bed59a700 1 -- 172.21.15.86:0/978691366 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6be800e070 con 0x7f6bf015fdb0 2023-03-06T13:49:19.480 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.460+0000 7f6bed59a700 1 -- 172.21.15.86:0/978691366 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6be80092e0 con 0x7f6bf015fdb0 2023-03-06T13:49:19.480 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.460+0000 7f6bed59a700 1 -- 172.21.15.86:0/978691366 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6be40015f0 con 0x7f6bf015fdb0 2023-03-06T13:49:19.480 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.460+0000 7ff3a1ea1700 1 -- 172.21.15.86:0/3368831925 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff39c0c19d0 msgr2=0x7ff39c0b8c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:19.481 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.460+0000 7ff3a1ea1700 1 --2- 172.21.15.86:0/3368831925 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff39c0c19d0 0x7ff39c0b8c00 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7ff394007730 tx=0x7ff39400b330 comp rx=0 tx=0).stop 2023-03-06T13:49:19.481 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.460+0000 7fd49959a700 1 -- 172.21.15.86:0/2214309197 <== mon.1 v1:172.21.15.202:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1519032542 0 0) 0x7fd49c152720 con 0x7fd49c0c11f0 2023-03-06T13:49:19.481 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.460+0000 7fd49959a700 1 -- 172.21.15.86:0/2214309197 --> v1:172.21.15.202:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd4840035b0 con 0x7fd49c0c11f0 2023-03-06T13:49:19.482 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.460+0000 7ff3a1ea1700 1 -- 172.21.15.86:0/3368831925 shutdown_connections 2023-03-06T13:49:19.482 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.460+0000 7ff3a1ea1700 1 --2- 172.21.15.86:0/3368831925 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff39c0c19d0 0x7ff39c0b8c00 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:19.482 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.460+0000 7ff3a1ea1700 1 -- 172.21.15.86:0/3368831925 >> 172.21.15.86:0/3368831925 conn(0x7ff39c06afc0 msgr2=0x7ff39c0c1050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T13:49:19.482 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.460+0000 7ff3a1ea1700 1 -- 172.21.15.86:0/3368831925 shutdown_connections 2023-03-06T13:49:19.482 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.460+0000 7ff3a1ea1700 1 -- 172.21.15.86:0/3368831925 wait complete. 2023-03-06T13:49:19.483 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.459+0000 7f0f94d51700 1 -- start start 2023-03-06T13:49:19.483 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.461+0000 7f0f94d51700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f0f900bb9d0 0x7f0f90153560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:19.483 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.461+0000 7f0f94d51700 1 --2- >> v2:172.21.15.202:3300/0 conn(0x7f0f900a6e80 0x7f0f900bc2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:19.483 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.461+0000 7f0f94d51700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f900b81f0 con 0x7f0f900bad50 2023-03-06T13:49:19.483 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.461+0000 7f0f94d51700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f900bc800 con 0x7f0f900bb9d0 2023-03-06T13:49:19.483 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.461+0000 7f0f94d51700 1 -- --> v2:172.21.15.202:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f900b7f10 con 0x7f0f900a6e80 2023-03-06T13:49:19.484 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.461+0000 7fe0884b2700 1 --2- >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fe0800a6e80 0x7fe080070ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:19.484 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.461+0000 7fe0884b2700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe0800bad50 0x7fe08006fc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:19.484 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.461+0000 7fe0884b2700 1 --2- >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7fe0800bb9d0 0x7fe080136d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:19.484 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.461+0000 7fe0884b2700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0801439a0 con 0x7fe0800bad50 2023-03-06T13:49:19.484 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.461+0000 7fe0884b2700 1 -- --> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe080152f90 con 0x7fe0800bb9d0 2023-03-06T13:49:19.484 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.461+0000 7fe0884b2700 1 -- --> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe080071400 con 0x7fe0800a6e80 2023-03-06T13:49:19.485 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.461+0000 7f0f8dd9b700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f0f900bb9d0 0x7f0f90153560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:19.485 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.461+0000 7f0f8dd9b700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f0f900bb9d0 0x7f0f90153560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:38768/0 (socket says 172.21.15.86:38768) 2023-03-06T13:49:19.485 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.461+0000 7f0f8dd9b700 1 -- 172.21.15.86:0/1055144799 learned_addr learned my addr 172.21.15.86:0/1055144799 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-03-06T13:49:19.485 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.461+0000 7f0f8dd9b700 1 -- 172.21.15.86:0/1055144799 >> v2:172.21.15.202:3300/0 conn(0x7f0f900a6e80 msgr2=0x7f0f900bc2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T13:49:19.486 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.461+0000 7f0f8dd9b700 1 --2- 172.21.15.86:0/1055144799 >> v2:172.21.15.202:3300/0 conn(0x7f0f900a6e80 0x7f0f900bc2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:19.486 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.461+0000 7f0f8dd9b700 1 -- 172.21.15.86:0/1055144799 >> v1:172.21.15.86:6789/0 conn(0x7f0f900bad50 legacy=0x7f0f900c1760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T13:49:19.486 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.461+0000 7f0f8dd9b700 1 -- 172.21.15.86:0/1055144799 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f900b6310 con 0x7f0f900bb9d0 2023-03-06T13:49:19.486 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.462+0000 7fe08624e700 1 --2- >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fe0800a6e80 0x7fe080070ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:19.487 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.460+0000 7fdb86d9c700 1 -- start start 2023-03-06T13:49:19.487 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.461+0000 7fdb86d9c700 1 --2- >> v2:172.21.15.202:3300/0 conn(0x7fdb801461d0 0x7fdb800beb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:19.487 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.462+0000 7fdb86d9c700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fdb800bf0d0 0x7fdb8014f430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:19.487 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.462+0000 7fdb86d9c700 1 -- --> v1:172.21.15.202:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb80071a80 con 0x7fdb8014f970 2023-03-06T13:49:19.487 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.462+0000 7fdb86d9c700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb80070f40 con 0x7fdb800bf0d0 2023-03-06T13:49:19.487 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.462+0000 7fdb86d9c700 1 -- --> v2:172.21.15.202:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb800bcda0 con 0x7fdb801461d0 2023-03-06T13:49:19.488 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.460+0000 7f42cb705700 1 -- 172.21.15.86:0/2544310656 wait complete. 2023-03-06T13:49:19.488 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.462+0000 7f42cb705700 1 Processor -- start 2023-03-06T13:49:19.488 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.462+0000 7f42cb705700 1 -- start start 2023-03-06T13:49:19.488 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.462+0000 7fd499d9b700 1 -- 172.21.15.86:0/2214309197 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fd49c149700 msgr2=0x7fd49c0a6f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T13:49:19.489 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.462+0000 7fd499d9b700 1 --2- 172.21.15.86:0/2214309197 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fd49c149700 0x7fd49c0a6f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:19.489 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.462+0000 7fd499d9b700 1 -- 172.21.15.86:0/2214309197 >> v1:172.21.15.202:6789/0 conn(0x7fd49c0c11f0 legacy=0x7fd49c14f190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:19.489 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.462+0000 7fd499d9b700 1 -- 172.21.15.86:0/2214309197 --> v2:172.21.15.202:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd49c152970 con 0x7fd49c0a7450 2023-03-06T13:49:19.489 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.462+0000 7fdb84b38700 1 --2- >> v2:172.21.15.202:3300/0 conn(0x7fdb801461d0 0x7fdb800beb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:19.489 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.462+0000 7fdb84b38700 1 --2- >> v2:172.21.15.202:3300/0 conn(0x7fdb801461d0 0x7fdb800beb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.202:3300/0 says I am v2:172.21.15.86:44308/0 (socket says 172.21.15.86:44308) 2023-03-06T13:49:19.490 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.462+0000 7fdb84b38700 1 -- 172.21.15.86:0/4170938999 learned_addr learned my addr 172.21.15.86:0/4170938999 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-03-06T13:49:19.490 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.462+0000 7ff3a1ea1700 1 Processor -- start 2023-03-06T13:49:19.490 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.462+0000 7fd499d9b700 1 --2- 172.21.15.86:0/2214309197 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7fd49c0a7450 0x7fd49c1507d0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fd48c009840 tx=0x7fd48c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8deffdcad6409ad1 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T13:49:19.490 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.462+0000 7fdb84b38700 1 -- 172.21.15.86:0/4170938999 >> v2:172.21.15.86:3300/0 conn(0x7fdb800bf0d0 msgr2=0x7fdb8014f430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T13:49:19.491 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.462+0000 7fdb84b38700 1 --2- 172.21.15.86:0/4170938999 >> v2:172.21.15.86:3300/0 conn(0x7fdb800bf0d0 0x7fdb8014f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:19.491 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.462+0000 7fdb84b38700 1 -- 172.21.15.86:0/4170938999 >> v1:172.21.15.202:6789/0 conn(0x7fdb8014f970 legacy=0x7fdb8006d8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T13:49:19.491 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.462+0000 7fdb84b38700 1 -- 172.21.15.86:0/4170938999 --> v2:172.21.15.202:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb8014fdb0 con 0x7fdb801461d0 2023-03-06T13:49:19.491 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.462+0000 7f6bf4e89700 1 -- 172.21.15.86:0/978691366 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6bf015fdb0 msgr2=0x7f6bf0167970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:19.491 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.462+0000 7f6bf4e89700 1 --2- 172.21.15.86:0/978691366 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6bf015fdb0 0x7f6bf0167970 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f6be800b370 tx=0x7f6be800bf10 comp rx=0 tx=0).stop 2023-03-06T13:49:19.492 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.462+0000 7fe086a4f700 1 --2- >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7fe0800bb9d0 0x7fe080136d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:19.492 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.462+0000 7fe086a4f700 1 --2- >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7fe0800bb9d0 0x7fe080136d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.202:3300/0 says I am v2:172.21.15.86:44312/0 (socket says 172.21.15.86:44312) 2023-03-06T13:49:19.492 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.462+0000 7fe086a4f700 1 -- 172.21.15.86:0/705016231 learned_addr learned my addr 172.21.15.86:0/705016231 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-03-06T13:49:19.492 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.463+0000 7f6bf4e89700 1 -- 172.21.15.86:0/978691366 shutdown_connections 2023-03-06T13:49:19.493 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.463+0000 7f6bf4e89700 1 --2- 172.21.15.86:0/978691366 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6bf015fdb0 0x7f6bf0167970 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:19.493 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.463+0000 7f6bf4e89700 1 -- 172.21.15.86:0/978691366 >> 172.21.15.86:0/978691366 conn(0x7f6bf006afc0 msgr2=0x7f6bf00c1050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T13:49:19.493 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.463+0000 7fd49959a700 1 -- 172.21.15.86:0/2214309197 <== mon.1 v2:172.21.15.202:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd48c011830 con 0x7fd49c0a7450 2023-03-06T13:49:19.493 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.463+0000 7fd49959a700 1 -- 172.21.15.86:0/2214309197 <== mon.1 v2:172.21.15.202:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd48c011990 con 0x7fd49c0a7450 2023-03-06T13:49:19.493 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.463+0000 7fd49959a700 1 -- 172.21.15.86:0/2214309197 <== mon.1 v2:172.21.15.202:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd48c011d20 con 0x7fd49c0a7450 2023-03-06T13:49:19.494 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.463+0000 7f42cb705700 1 --2- >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f42b0004850 0x7f42c4159440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:19.494 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.463+0000 7f42cb705700 1 --2- >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f42c41498d0 0x7f42c41585d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:19.494 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.463+0000 7f42cb705700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f42c4071110 0x7f42c414b280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:19.494 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.463+0000 7f42cb705700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42c4148460 con 0x7f42c4071110 2023-03-06T13:49:19.494 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.463+0000 7f42cb705700 1 -- --> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42c4149d40 con 0x7f42c41498d0 2023-03-06T13:49:19.495 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.463+0000 7f42cb705700 1 -- --> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42c4157eb0 con 0x7f42b0004850 2023-03-06T13:49:19.495 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.463+0000 7f42c94a1700 1 --2- >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f42b0004850 0x7f42c4159440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:19.495 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.463+0000 7fe086a4f700 1 -- 172.21.15.86:0/705016231 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fe0800a6e80 msgr2=0x7fe080070ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:19.495 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.463+0000 7fe086a4f700 1 --2- 172.21.15.86:0/705016231 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fe0800a6e80 0x7fe080070ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:19.495 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.463+0000 7fe086a4f700 1 -- 172.21.15.86:0/705016231 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe0800bad50 msgr2=0x7fe08006fc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:19.495 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.463+0000 7fe086a4f700 1 --2- 172.21.15.86:0/705016231 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe0800bad50 0x7fe08006fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:19.496 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.463+0000 7fe086a4f700 1 -- 172.21.15.86:0/705016231 --> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe07c0094a0 con 0x7fe0800bb9d0 2023-03-06T13:49:19.496 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.463+0000 7fdb84b38700 1 --2- 172.21.15.86:0/4170938999 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7fdb801461d0 0x7fdb800beb90 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fdb800702e0 tx=0x7fdb7400be70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=63f66cf9ff011d0c server_cookie=0 in_seq=0 out_seq=0 2023-03-06T13:49:19.496 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.463+0000 7f6bf4e89700 1 -- 172.21.15.86:0/978691366 shutdown_connections 2023-03-06T13:49:19.496 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.463+0000 7f6bf4e89700 1 -- 172.21.15.86:0/978691366 wait complete. 2023-03-06T13:49:19.497 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.463+0000 7f42c94a1700 1 --2- >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f42b0004850 0x7f42c4159440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.202:3301/0 says I am v2:172.21.15.86:50478/0 (socket says 172.21.15.86:50478) 2023-03-06T13:49:19.497 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.463+0000 7f42c94a1700 1 -- 172.21.15.86:0/3654800486 learned_addr learned my addr 172.21.15.86:0/3654800486 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-03-06T13:49:19.497 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.463+0000 7f42c8ca0700 1 --2- 172.21.15.86:0/3654800486 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f42c41498d0 0x7f42c41585d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:19.497 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.463+0000 7fdb7f7fe700 1 -- 172.21.15.86:0/4170938999 <== mon.1 v2:172.21.15.202:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb7400dcf0 con 0x7fdb801461d0 2023-03-06T13:49:19.498 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.463+0000 7fe086a4f700 1 --2- 172.21.15.86:0/705016231 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7fe0800bb9d0 0x7fe080136d70 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fe07800cad0 tx=0x7fe07800ce90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T13:49:19.498 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.463+0000 7fdb7f7fe700 1 -- 172.21.15.86:0/4170938999 <== mon.1 v2:172.21.15.202:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb7400de50 con 0x7fdb801461d0 2023-03-06T13:49:19.498 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.463+0000 7fdb7f7fe700 1 -- 172.21.15.86:0/4170938999 <== mon.1 v2:172.21.15.202:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb74004250 con 0x7fdb801461d0 2023-03-06T13:49:19.498 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.463+0000 7f42c94a1700 1 -- 172.21.15.86:0/3654800486 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f42c41498d0 msgr2=0x7f42c41585d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:19.499 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.463+0000 7f42c94a1700 1 --2- 172.21.15.86:0/3654800486 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f42c41498d0 0x7f42c41585d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:19.499 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.463+0000 7f42c94a1700 1 -- 172.21.15.86:0/3654800486 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f42c4071110 msgr2=0x7f42c414b280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:19.499 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.463+0000 7f42c94a1700 1 --2- 172.21.15.86:0/3654800486 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f42c4071110 0x7f42c414b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:19.499 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.463+0000 7f42c94a1700 1 -- 172.21.15.86:0/3654800486 --> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42c40c03e0 con 0x7f42b0004850 2023-03-06T13:49:19.500 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.463+0000 7fe076ffd700 1 -- 172.21.15.86:0/705016231 <== mon.1 v2:172.21.15.202:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe07800aac0 con 0x7fe0800bb9d0 2023-03-06T13:49:19.500 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.464+0000 7fe076ffd700 1 -- 172.21.15.86:0/705016231 <== mon.1 v2:172.21.15.202:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe07800ac20 con 0x7fe0800bb9d0 2023-03-06T13:49:19.500 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.464+0000 7fe0884b2700 1 -- 172.21.15.86:0/705016231 --> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0800b68d0 con 0x7fe0800bb9d0 2023-03-06T13:49:19.500 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.464+0000 7fd4a0fd8700 1 -- 172.21.15.86:0/2214309197 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7fd49c0a7450 msgr2=0x7fd49c1507d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:19.501 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.464+0000 7fd4a0fd8700 1 --2- 172.21.15.86:0/2214309197 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7fd49c0a7450 0x7fd49c1507d0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fd48c009840 tx=0x7fd48c009b50 comp rx=0 tx=0).stop 2023-03-06T13:49:19.501 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.464+0000 7f42c94a1700 1 --2- 172.21.15.86:0/3654800486 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f42b0004850 0x7f42c4159440 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f42c000f9a0 tx=0x7f42c000fd60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T13:49:19.501 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.462+0000 7ff3a1ea1700 1 -- start start 2023-03-06T13:49:19.502 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.464+0000 7ff3a1ea1700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff39c06cfb0 0x7ff39c0badf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:19.502 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.464+0000 7ff3a1ea1700 1 --2- >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7ff39c0bc1f0 0x7ff39c09b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:19.502 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.464+0000 7ff3a1ea1700 1 --2- >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7ff39c0c19d0 0x7ff39c099cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:19.502 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.464+0000 7ff3a1ea1700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff39c0720d0 con 0x7ff39c06cfb0 2023-03-06T13:49:19.502 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.464+0000 7ff3a1ea1700 1 -- --> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff39c0723b0 con 0x7ff39c0bc1f0 2023-03-06T13:49:19.502 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.464+0000 7ff3a1ea1700 1 -- --> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff39c09a6a0 con 0x7ff39c0c19d0 2023-03-06T13:49:19.503 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.464+0000 7f42b9ffb700 1 -- 172.21.15.86:0/3654800486 <== mon.2 v2:172.21.15.202:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42c000dac0 con 0x7f42b0004850 2023-03-06T13:49:19.503 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.464+0000 7f0f8dd9b700 1 --2- 172.21.15.86:0/1055144799 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0f900bb9d0 0x7f0f90153560 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f0f90154660 tx=0x7f0f84009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee9b2fb5e249b37f server_cookie=0 in_seq=0 out_seq=0 2023-03-06T13:49:19.503 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.464+0000 7ff39affd700 1 --2- >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7ff39c0bc1f0 0x7ff39c09b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:19.503 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.464+0000 7ff39affd700 1 --2- >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7ff39c0bc1f0 0x7ff39c09b1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.202:3300/0 says I am v2:172.21.15.86:44322/0 (socket says 172.21.15.86:44322) 2023-03-06T13:49:19.504 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.464+0000 7ff39affd700 1 -- 172.21.15.86:0/996205330 learned_addr learned my addr 172.21.15.86:0/996205330 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-03-06T13:49:19.504 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.464+0000 7ff39bfff700 1 --2- 172.21.15.86:0/996205330 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7ff39c0c19d0 0x7ff39c099cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:19.504 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.464+0000 7f0f8d59a700 1 -- 172.21.15.86:0/1055144799 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f84004230 con 0x7f0f900bb9d0 2023-03-06T13:49:19.504 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.465+0000 7f0f8d59a700 1 -- 172.21.15.86:0/1055144799 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f84004390 con 0x7f0f900bb9d0 2023-03-06T13:49:19.504 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.465+0000 7f0f8d59a700 1 -- 172.21.15.86:0/1055144799 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f840036a0 con 0x7f0f900bb9d0 2023-03-06T13:49:19.505 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.465+0000 7ff39bfff700 1 -- 172.21.15.86:0/996205330 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7ff39c0bc1f0 msgr2=0x7ff39c09b1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:19.505 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.465+0000 7ff39bfff700 1 --2- 172.21.15.86:0/996205330 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7ff39c0bc1f0 0x7ff39c09b1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:19.505 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.465+0000 7ff39bfff700 1 -- 172.21.15.86:0/996205330 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff39c06cfb0 msgr2=0x7ff39c0badf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:19.505 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.465+0000 7ff39bfff700 1 --2- 172.21.15.86:0/996205330 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff39c06cfb0 0x7ff39c0badf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:19.505 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.465+0000 7ff39bfff700 1 -- 172.21.15.86:0/996205330 --> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff394009b40 con 0x7ff39c0c19d0 2023-03-06T13:49:19.506 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.465+0000 7fd4a0fd8700 1 -- 172.21.15.86:0/2214309197 shutdown_connections 2023-03-06T13:49:19.506 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.465+0000 7fd4a0fd8700 1 --2- 172.21.15.86:0/2214309197 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fd49c149700 0x7fd49c0a6f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:19.506 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.465+0000 7fd4a0fd8700 1 --2- 172.21.15.86:0/2214309197 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7fd49c0a7450 0x7fd49c1507d0 secure :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fd48c009840 tx=0x7fd48c009b50 comp rx=0 tx=0).stop 2023-03-06T13:49:19.506 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.465+0000 7fd4a0fd8700 1 -- 172.21.15.86:0/2214309197 >> 172.21.15.86:0/2214309197 conn(0x7fd49c071a60 msgr2=0x7fd49c071e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T13:49:19.506 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.464+0000 7fe076ffd700 1 -- 172.21.15.86:0/705016231 <== mon.1 v2:172.21.15.202:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe078012400 con 0x7fe0800bb9d0 2023-03-06T13:49:19.506 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.464+0000 7fe0884b2700 1 -- 172.21.15.86:0/705016231 --> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0800b65f0 con 0x7fe0800bb9d0 2023-03-06T13:49:19.507 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.465+0000 7ff39bfff700 1 --2- 172.21.15.86:0/996205330 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7ff39c0c19d0 0x7ff39c099cb0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7ff38c000f60 tx=0x7ff38c00c790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T13:49:19.507 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.465+0000 7fe0884b2700 1 -- 172.21.15.86:0/705016231 --> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe0800c1e70 con 0x7fe0800bb9d0 2023-03-06T13:49:19.507 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.464+0000 7f42cb705700 1 -- 172.21.15.86:0/3654800486 --> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42c40c0100 con 0x7f42b0004850 2023-03-06T13:49:19.508 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.464+0000 7f42cb705700 1 -- 172.21.15.86:0/3654800486 --> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42c40c12c0 con 0x7f42b0004850 2023-03-06T13:49:19.508 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.465+0000 7f42cb705700 1 -- 172.21.15.86:0/3654800486 --> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f42c404e750 con 0x7f42b0004850 2023-03-06T13:49:19.508 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.465+0000 7f0f94d51700 1 -- 172.21.15.86:0/1055144799 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0f900bb9d0 msgr2=0x7f0f90153560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:19.508 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.465+0000 7f0f94d51700 1 --2- 172.21.15.86:0/1055144799 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0f900bb9d0 0x7f0f90153560 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f0f90154660 tx=0x7f0f84009bd0 comp rx=0 tx=0).stop 2023-03-06T13:49:19.509 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.465+0000 7f42b9ffb700 1 -- 172.21.15.86:0/3654800486 <== mon.2 v2:172.21.15.202:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42c000c040 con 0x7f42b0004850 2023-03-06T13:49:19.509 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.465+0000 7f42b9ffb700 1 -- 172.21.15.86:0/3654800486 <== mon.2 v2:172.21.15.202:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42c000de40 con 0x7f42b0004850 2023-03-06T13:49:19.509 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.466+0000 7f0f94d51700 1 -- 172.21.15.86:0/1055144799 shutdown_connections 2023-03-06T13:49:19.509 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.466+0000 7f0f94d51700 1 --2- 172.21.15.86:0/1055144799 >> v2:172.21.15.202:3300/0 conn(0x7f0f900a6e80 0x7f0f900bc2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:19.509 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.466+0000 7f0f94d51700 1 --2- 172.21.15.86:0/1055144799 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0f900bb9d0 0x7f0f90153560 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:19.510 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.466+0000 7f0f94d51700 1 -- 172.21.15.86:0/1055144799 >> 172.21.15.86:0/1055144799 conn(0x7f0f9006afc0 msgr2=0x7f0f900c1050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T13:49:19.510 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.466+0000 7ff383fff700 1 -- 172.21.15.86:0/996205330 <== mon.2 v2:172.21.15.202:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff38c0052d0 con 0x7ff39c0c19d0 2023-03-06T13:49:19.510 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.466+0000 7ff383fff700 1 -- 172.21.15.86:0/996205330 <== mon.2 v2:172.21.15.202:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff38c005450 con 0x7ff39c0c19d0 2023-03-06T13:49:19.510 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.466+0000 7ff3a1ea1700 1 -- 172.21.15.86:0/996205330 --> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff39c0b8660 con 0x7ff39c0c19d0 2023-03-06T13:49:19.511 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.466+0000 7ff3a1ea1700 1 -- 172.21.15.86:0/996205330 --> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff39c0b6ee0 con 0x7ff39c0c19d0 2023-03-06T13:49:19.511 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.466+0000 7ff383fff700 1 -- 172.21.15.86:0/996205330 <== mon.2 v2:172.21.15.202:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff38c0038c0 con 0x7ff39c0c19d0 2023-03-06T13:49:19.511 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.466+0000 7fe076ffd700 1 -- 172.21.15.86:0/705016231 <== mon.1 v2:172.21.15.202:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fe078019030 con 0x7fe0800bb9d0 2023-03-06T13:49:19.511 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.466+0000 7fdb86d9c700 1 -- 172.21.15.86:0/4170938999 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7fdb801461d0 msgr2=0x7fdb800beb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:19.511 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.466+0000 7fdb86d9c700 1 --2- 172.21.15.86:0/4170938999 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7fdb801461d0 0x7fdb800beb90 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fdb800702e0 tx=0x7fdb7400be70 comp rx=0 tx=0).stop 2023-03-06T13:49:19.512 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.465+0000 7f6bf4e89700 1 Processor -- start 2023-03-06T13:49:19.512 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.466+0000 7f0f94d51700 1 -- 172.21.15.86:0/1055144799 shutdown_connections 2023-03-06T13:49:19.512 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.466+0000 7f0f94d51700 1 -- 172.21.15.86:0/1055144799 wait complete. 2023-03-06T13:49:19.513 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.467+0000 7ff3a1ea1700 1 -- 172.21.15.86:0/996205330 --> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff37c000fb0 con 0x7ff39c0c19d0 2023-03-06T13:49:19.513 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.467+0000 7f42b9ffb700 1 -- 172.21.15.86:0/3654800486 <== mon.2 v2:172.21.15.202:3301/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f42c0013440 con 0x7f42b0004850 2023-03-06T13:49:19.514 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.467+0000 7fe076ffd700 1 --2- 172.21.15.86:0/705016231 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7fe064068340 0x7fe06406a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:19.514 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.467+0000 7fe076ffd700 1 -- 172.21.15.86:0/705016231 <== mon.1 v2:172.21.15.202:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe078085890 con 0x7fe0800bb9d0 2023-03-06T13:49:19.514 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.467+0000 7fe076ffd700 1 --2- 172.21.15.86:0/705016231 >> [v2:172.21.15.202:6808/96845,v1:172.21.15.202:6809/96845] conn(0x7fe064070bf0 0x7fe064073000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:19.514 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.467+0000 7fe076ffd700 1 -- 172.21.15.86:0/705016231 --> [v2:172.21.15.202:6808/96845,v1:172.21.15.202:6809/96845] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe0640736b0 con 0x7fe064070bf0 2023-03-06T13:49:19.514 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.467+0000 7fe076ffd700 1 -- 172.21.15.86:0/705016231 <== mon.1 v2:172.21.15.202:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe07808a2a0 con 0x7fe0800bb9d0 2023-03-06T13:49:19.514 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.467+0000 7fe085a4d700 1 --2- 172.21.15.86:0/705016231 >> [v2:172.21.15.202:6808/96845,v1:172.21.15.202:6809/96845] conn(0x7fe064070bf0 0x7fe064073000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:19.514 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.467+0000 7fe085a4d700 1 --2- 172.21.15.86:0/705016231 >> [v2:172.21.15.202:6808/96845,v1:172.21.15.202:6809/96845] conn(0x7fe064070bf0 0x7fe064073000 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T13:49:19.515 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.468+0000 7f42b9ffb700 1 --2- 172.21.15.86:0/3654800486 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7f42a80682f0 0x7f42a806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:19.515 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.468+0000 7f42b9ffb700 1 -- 172.21.15.86:0/3654800486 <== mon.2 v2:172.21.15.202:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f42c0086890 con 0x7f42b0004850 2023-03-06T13:49:19.515 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.468+0000 7f42b9ffb700 1 --2- 172.21.15.86:0/3654800486 >> [v2:172.21.15.202:6824/96848,v1:172.21.15.202:6825/96848] conn(0x7f42a8070b20 0x7f42a8072f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:19.515 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.468+0000 7f42b9ffb700 1 -- 172.21.15.86:0/3654800486 --> [v2:172.21.15.202:6824/96848,v1:172.21.15.202:6825/96848] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f42a80735e0 con 0x7f42a8070b20 2023-03-06T13:49:19.516 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.468+0000 7f42b9ffb700 1 -- 172.21.15.86:0/3654800486 <== mon.2 v2:172.21.15.202:3301/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f42c0086cf0 con 0x7f42b0004850 2023-03-06T13:49:19.516 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.468+0000 7f42c9ca2700 1 --2- 172.21.15.86:0/3654800486 >> [v2:172.21.15.202:6824/96848,v1:172.21.15.202:6825/96848] conn(0x7f42a8070b20 0x7f42a8072f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:19.516 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.468+0000 7fe076ffd700 1 -- 172.21.15.86:0/705016231 <== osd.6 v2:172.21.15.202:6808/96845 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fe0640736b0 con 0x7fe064070bf0 2023-03-06T13:49:19.516 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.468+0000 7f0f94d51700 1 Processor -- start 2023-03-06T13:49:19.517 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.468+0000 7ff383fff700 1 -- 172.21.15.86:0/996205330 <== mon.2 v2:172.21.15.202:3301/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7ff38c019030 con 0x7ff39c0c19d0 2023-03-06T13:49:19.517 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.468+0000 7ff383fff700 1 --2- 172.21.15.86:0/996205330 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7ff388068340 0x7ff38806a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:19.517 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.468+0000 7ff383fff700 1 -- 172.21.15.86:0/996205330 <== mon.2 v2:172.21.15.202:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff38c085590 con 0x7ff39c0c19d0 2023-03-06T13:49:19.517 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.468+0000 7ff39b7fe700 1 --2- 172.21.15.86:0/996205330 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7ff388068340 0x7ff38806a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:19.517 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.468+0000 7ff383fff700 1 --2- 172.21.15.86:0/996205330 >> [v2:172.21.15.86:6808/96740,v1:172.21.15.86:6809/96740] conn(0x7ff388070bf0 0x7ff388073000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:19.517 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.468+0000 7ff383fff700 1 -- 172.21.15.86:0/996205330 --> [v2:172.21.15.86:6808/96740,v1:172.21.15.86:6809/96740] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff3880736b0 con 0x7ff388070bf0 2023-03-06T13:49:19.518 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.468+0000 7ff383fff700 1 -- 172.21.15.86:0/996205330 <== mon.2 v2:172.21.15.202:3301/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff38c085a10 con 0x7ff39c0c19d0 2023-03-06T13:49:19.518 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.469+0000 7ff39affd700 1 --2- 172.21.15.86:0/996205330 >> [v2:172.21.15.86:6808/96740,v1:172.21.15.86:6809/96740] conn(0x7ff388070bf0 0x7ff388073000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:19.518 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.469+0000 7f42c8ca0700 1 --2- 172.21.15.86:0/3654800486 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7f42a80682f0 0x7f42a806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:19.518 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.469+0000 7fe08624e700 1 --2- 172.21.15.86:0/705016231 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7fe064068340 0x7fe06406a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:19.519 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.469+0000 7f0f94d51700 1 -- start start 2023-03-06T13:49:19.519 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.470+0000 7f0f94d51700 1 --2- >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f0f900a6e80 0x7f0f901441d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:19.519 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.470+0000 7f0f94d51700 1 --2- >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f0f900bad50 0x7f0f9013cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:19.519 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.470+0000 7f0f94d51700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0f900bb9d0 0x7f0f900c0810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:19.519 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.470+0000 7f0f94d51700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f90071030 con 0x7f0f900bb9d0 2023-03-06T13:49:19.519 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.470+0000 7f0f94d51700 1 -- --> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f900728a0 con 0x7f0f900bad50 2023-03-06T13:49:19.520 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.470+0000 7f0f94d51700 1 -- --> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f9013e6c0 con 0x7f0f900a6e80 2023-03-06T13:49:19.520 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.470+0000 7f0f8e59c700 1 --2- >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f0f900a6e80 0x7f0f901441d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:19.520 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.470+0000 7f0f8e59c700 1 --2- >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f0f900a6e80 0x7f0f901441d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.202:3301/0 says I am v2:172.21.15.86:50508/0 (socket says 172.21.15.86:50508) 2023-03-06T13:49:19.520 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.470+0000 7f0f8e59c700 1 -- 172.21.15.86:0/643381663 learned_addr learned my addr 172.21.15.86:0/643381663 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-03-06T13:49:19.520 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.470+0000 7f0f8ed9d700 1 --2- 172.21.15.86:0/643381663 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0f900bb9d0 0x7f0f900c0810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:19.520 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.471+0000 7f0f8ed9d700 1 -- 172.21.15.86:0/643381663 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f0f900a6e80 msgr2=0x7f0f901441d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:19.520 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.471+0000 7f0f8ed9d700 1 --2- 172.21.15.86:0/643381663 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f0f900a6e80 0x7f0f901441d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:19.520 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.471+0000 7f0f8ed9d700 1 -- 172.21.15.86:0/643381663 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f0f900bad50 msgr2=0x7f0f9013cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:19.521 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.471+0000 7f0f8ed9d700 1 --2- 172.21.15.86:0/643381663 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f0f900bad50 0x7f0f9013cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:19.521 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.471+0000 7f0f8ed9d700 1 -- 172.21.15.86:0/643381663 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f84009550 con 0x7f0f900bb9d0 2023-03-06T13:49:19.521 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.467+0000 7f6bf4e89700 1 -- start start 2023-03-06T13:49:19.521 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.468+0000 7f6bf4e89700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6bf00bc1f0 0x7f6bf015e000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:19.521 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.468+0000 7f6bf4e89700 1 --2- >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f6bf00c19d0 0x7f6bf0071030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:19.521 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.468+0000 7f6bf4e89700 1 --2- >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f6bf015fdb0 0x7f6bf006f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:19.522 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.468+0000 7f6bf4e89700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bf0072850 con 0x7f6bf00bc1f0 2023-03-06T13:49:19.522 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.468+0000 7f6bf4e89700 1 -- --> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bf00723c0 con 0x7f6bf00c19d0 2023-03-06T13:49:19.522 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.468+0000 7f6bf4e89700 1 -- --> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bf015e540 con 0x7f6bf015fdb0 2023-03-06T13:49:19.522 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.468+0000 7f6beed9d700 1 --2- >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f6bf015fdb0 0x7f6bf006f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:19.522 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.468+0000 7f6bedd9b700 1 --2- >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f6bf00c19d0 0x7f6bf0071030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:19.522 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.468+0000 7f6bee59c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6bf00bc1f0 0x7f6bf015e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:19.522 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.469+0000 7f6bee59c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6bf00bc1f0 0x7f6bf015e000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:38804/0 (socket says 172.21.15.86:38804) 2023-03-06T13:49:19.522 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.469+0000 7f6bee59c700 1 -- 172.21.15.86:0/2438423212 learned_addr learned my addr 172.21.15.86:0/2438423212 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-03-06T13:49:19.523 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.469+0000 7f6bee59c700 1 -- 172.21.15.86:0/2438423212 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f6bf015fdb0 msgr2=0x7f6bf006f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:19.523 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.469+0000 7f6bee59c700 1 --2- 172.21.15.86:0/2438423212 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f6bf015fdb0 0x7f6bf006f4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:19.523 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.469+0000 7f6bee59c700 1 -- 172.21.15.86:0/2438423212 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f6bf00c19d0 msgr2=0x7f6bf0071030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:19.523 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.469+0000 7f6bee59c700 1 --2- 172.21.15.86:0/2438423212 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f6bf00c19d0 0x7f6bf0071030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:19.523 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.469+0000 7f6bee59c700 1 -- 172.21.15.86:0/2438423212 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6be800b050 con 0x7f6bf00bc1f0 2023-03-06T13:49:19.523 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.469+0000 7f6bee59c700 1 --2- 172.21.15.86:0/2438423212 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6bf00bc1f0 0x7f6bf015e000 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f6be400c780 tx=0x7f6be400ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T13:49:19.523 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.470+0000 7f6bdeffd700 1 -- 172.21.15.86:0/2438423212 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6be40054e0 con 0x7f6bf00bc1f0 2023-03-06T13:49:19.524 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.470+0000 7f6bdeffd700 1 -- 172.21.15.86:0/2438423212 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6be4003680 con 0x7f6bf00bc1f0 2023-03-06T13:49:19.524 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.470+0000 7f6bdeffd700 1 -- 172.21.15.86:0/2438423212 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6be4003a30 con 0x7f6bf00bc1f0 2023-03-06T13:49:19.524 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.469+0000 7ff39affd700 1 --2- 172.21.15.86:0/996205330 >> [v2:172.21.15.86:6808/96740,v1:172.21.15.86:6809/96740] conn(0x7ff388070bf0 0x7ff388073000 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T13:49:19.524 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.469+0000 7ff39b7fe700 1 --2- 172.21.15.86:0/996205330 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7ff388068340 0x7ff38806a7f0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7ff39c1fdbc0 tx=0x7ff39400f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T13:49:19.524 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.470+0000 7ff383fff700 1 -- 172.21.15.86:0/996205330 <== osd.2 v2:172.21.15.86:6808/96740 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7ff3880736b0 con 0x7ff388070bf0 2023-03-06T13:49:19.525 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.469+0000 7fd4a0fd8700 1 -- 172.21.15.86:0/2214309197 shutdown_connections 2023-03-06T13:49:19.525 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.469+0000 7fd4a0fd8700 1 -- 172.21.15.86:0/2214309197 wait complete. 2023-03-06T13:49:19.525 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.471+0000 7fd4a0fd8700 1 Processor -- start 2023-03-06T13:49:19.525 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.469+0000 7fdb86d9c700 1 -- 172.21.15.86:0/4170938999 shutdown_connections 2023-03-06T13:49:19.525 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.469+0000 7fdb86d9c700 1 --2- 172.21.15.86:0/4170938999 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7fdb801461d0 0x7fdb800beb90 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:19.526 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.469+0000 7fdb86d9c700 1 --2- 172.21.15.86:0/4170938999 >> v2:172.21.15.86:3300/0 conn(0x7fdb800bf0d0 0x7fdb8014f430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:19.526 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.469+0000 7fdb86d9c700 1 -- 172.21.15.86:0/4170938999 >> 172.21.15.86:0/4170938999 conn(0x7fdb8006b440 msgr2=0x7fdb8006b840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T13:49:19.526 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.470+0000 7fdb86d9c700 1 -- 172.21.15.86:0/4170938999 shutdown_connections 2023-03-06T13:49:19.526 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.469+0000 7f42c9ca2700 1 --2- 172.21.15.86:0/3654800486 >> [v2:172.21.15.202:6824/96848,v1:172.21.15.202:6825/96848] conn(0x7f42a8070b20 0x7f42a8072f30 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T13:49:19.526 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.471+0000 7f42c8ca0700 1 --2- 172.21.15.86:0/3654800486 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7f42a80682f0 0x7f42a806a7a0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f42bc014040 tx=0x7f42bc01d040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T13:49:19.527 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.471+0000 7f0f8ed9d700 1 --2- 172.21.15.86:0/643381663 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0f900bb9d0 0x7f0f900c0810 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f0f8800be80 tx=0x7f0f88009ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T13:49:19.527 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.470+0000 7fdb86d9c700 1 -- 172.21.15.86:0/4170938999 wait complete. 2023-03-06T13:49:19.527 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.471+0000 7fdb86d9c700 1 Processor -- start 2023-03-06T13:49:19.527 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.471+0000 7fe08624e700 1 --2- 172.21.15.86:0/705016231 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7fe064068340 0x7fe06406a7f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fe07c009b90 tx=0x7fe07c008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T13:49:19.528 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.471+0000 7fd4a0fd8700 1 -- start start 2023-03-06T13:49:19.528 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.471+0000 7f6bf4e89700 1 -- 172.21.15.86:0/2438423212 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bf00b6ee0 con 0x7f6bf00bc1f0 2023-03-06T13:49:19.528 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.472+0000 7f6bf4e89700 1 -- 172.21.15.86:0/2438423212 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bf00b6c00 con 0x7f6bf00bc1f0 2023-03-06T13:49:19.529 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.471+0000 7f0f7effd700 1 -- 172.21.15.86:0/643381663 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f8800cc10 con 0x7f0f900bb9d0 2023-03-06T13:49:19.529 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.471+0000 7f0f7effd700 1 -- 172.21.15.86:0/643381663 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f8800cd70 con 0x7f0f900bb9d0 2023-03-06T13:49:19.529 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.471+0000 7f0f7effd700 1 -- 172.21.15.86:0/643381663 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f88014680 con 0x7f0f900bb9d0 2023-03-06T13:49:19.529 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.471+0000 7f0f94d51700 1 -- 172.21.15.86:0/643381663 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f900b68d0 con 0x7f0f900bb9d0 2023-03-06T13:49:19.529 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.471+0000 7f0f94d51700 1 -- 172.21.15.86:0/643381663 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f900b65f0 con 0x7f0f900bb9d0 2023-03-06T13:49:19.529 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.473+0000 7f0f94d51700 1 -- 172.21.15.86:0/643381663 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f0f900c1e70 con 0x7f0f900bb9d0 2023-03-06T13:49:19.530 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.472+0000 7fd4a0fd8700 1 --2- >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fd49c0c11f0 0x7fd49c0beb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:19.530 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.472+0000 7fd4a0fd8700 1 --2- >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7fd49c1e9390 0x7fd49c0c5940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:19.530 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.472+0000 7fd4a0fd8700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd49c1e8730 0x7fd49c147e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:19.531 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.472+0000 7fd4a0fd8700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd49c146730 con 0x7fd49c1e8730 2023-03-06T13:49:19.531 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.472+0000 7fd4a0fd8700 1 -- --> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd49c1461f0 con 0x7fd49c1e9390 2023-03-06T13:49:19.531 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.472+0000 7fd4a0fd8700 1 -- --> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd49c151600 con 0x7fd49c0c11f0 2023-03-06T13:49:19.531 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.473+0000 7fd49a59c700 1 --2- >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fd49c0c11f0 0x7fd49c0beb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:19.531 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.473+0000 7fd49a59c700 1 --2- >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fd49c0c11f0 0x7fd49c0beb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.202:3301/0 says I am v2:172.21.15.86:50514/0 (socket says 172.21.15.86:50514) 2023-03-06T13:49:19.531 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.473+0000 7fd49a59c700 1 -- 172.21.15.86:0/2038763101 learned_addr learned my addr 172.21.15.86:0/2038763101 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-03-06T13:49:19.531 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.473+0000 7fd49ad9d700 1 --2- 172.21.15.86:0/2038763101 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd49c1e8730 0x7fd49c147e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:19.531 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.473+0000 7fd49a59c700 1 -- 172.21.15.86:0/2038763101 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7fd49c1e9390 msgr2=0x7fd49c0c5940 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-03-06T13:49:19.532 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.473+0000 7fd49a59c700 1 --2- 172.21.15.86:0/2038763101 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7fd49c1e9390 0x7fd49c0c5940 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:19.532 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.473+0000 7fd49a59c700 1 -- 172.21.15.86:0/2038763101 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd49c1e8730 msgr2=0x7fd49c147e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:19.532 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.473+0000 7fd49a59c700 1 --2- 172.21.15.86:0/2038763101 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd49c1e8730 0x7fd49c147e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:19.532 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.473+0000 7fd49a59c700 1 -- 172.21.15.86:0/2038763101 --> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd48c0094a0 con 0x7fd49c0c11f0 2023-03-06T13:49:19.532 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.473+0000 7fd49a59c700 1 --2- 172.21.15.86:0/2038763101 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fd49c0c11f0 0x7fd49c0beb60 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fd49000e8b0 tx=0x7fd49000ebc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T13:49:19.532 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.473+0000 7fdb86d9c700 1 -- start start 2023-03-06T13:49:19.533 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.474+0000 7fdb86d9c700 1 --2- >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7fdb800bf0d0 0x7fdb8014e000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:19.533 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.474+0000 7fdb86d9c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdb801461d0 0x7fdb801eb960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:19.533 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.474+0000 7fdb86d9c700 1 --2- >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fdb8014f970 0x7fdb8014ace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:19.533 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.474+0000 7fdb86d9c700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb801e99a0 con 0x7fdb801461d0 2023-03-06T13:49:19.533 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.474+0000 7fdb86d9c700 1 -- --> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb8014d000 con 0x7fdb800bf0d0 2023-03-06T13:49:19.533 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.474+0000 7fdb86d9c700 1 -- --> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb8014b780 con 0x7fdb8014f970 2023-03-06T13:49:19.533 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.474+0000 7fdb7ffff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdb801461d0 0x7fdb801eb960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:19.534 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.474+0000 7fdb7ffff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdb801461d0 0x7fdb801eb960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:38826/0 (socket says 172.21.15.86:38826) 2023-03-06T13:49:19.534 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.474+0000 7fdb7ffff700 1 -- 172.21.15.86:0/1113903194 learned_addr learned my addr 172.21.15.86:0/1113903194 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-03-06T13:49:19.534 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.474+0000 7fdb85339700 1 --2- 172.21.15.86:0/1113903194 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fdb8014f970 0x7fdb8014ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:19.534 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.474+0000 7fdb84b38700 1 --2- 172.21.15.86:0/1113903194 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7fdb800bf0d0 0x7fdb8014e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:19.534 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.475+0000 7fd48affd700 1 -- 172.21.15.86:0/2038763101 <== mon.2 v2:172.21.15.202:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd490013680 con 0x7fd49c0c11f0 2023-03-06T13:49:19.535 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.474+0000 7fdb7ffff700 1 -- 172.21.15.86:0/1113903194 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fdb8014f970 msgr2=0x7fdb8014ace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:19.535 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.474+0000 7fdb7ffff700 1 --2- 172.21.15.86:0/1113903194 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fdb8014f970 0x7fdb8014ace0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:19.535 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.475+0000 7fdb7ffff700 1 -- 172.21.15.86:0/1113903194 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7fdb800bf0d0 msgr2=0x7fdb8014e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:19.535 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.475+0000 7fdb7ffff700 1 --2- 172.21.15.86:0/1113903194 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7fdb800bf0d0 0x7fdb8014e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:19.535 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.475+0000 7fdb7ffff700 1 -- 172.21.15.86:0/1113903194 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb7400b7f0 con 0x7fdb801461d0 2023-03-06T13:49:19.535 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.475+0000 7fdb84b38700 1 --2- 172.21.15.86:0/1113903194 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7fdb800bf0d0 0x7fdb8014e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-06T13:49:19.536 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.475+0000 7fdb7ffff700 1 --2- 172.21.15.86:0/1113903194 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdb801461d0 0x7fdb801eb960 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fdb6c00b530 tx=0x7fdb6c00b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T13:49:19.536 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.475+0000 7f0f7effd700 1 -- 172.21.15.86:0/643381663 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f0f88025070 con 0x7f0f900bb9d0 2023-03-06T13:49:19.536 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.475+0000 7f0f7effd700 1 --2- 172.21.15.86:0/643381663 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7f0f700682f0 0x7f0f7006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:19.536 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.475+0000 7f0f7effd700 1 -- 172.21.15.86:0/643381663 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0f88006e40 con 0x7f0f900bb9d0 2023-03-06T13:49:19.536 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.475+0000 7f0f7effd700 1 --2- 172.21.15.86:0/643381663 >> [v2:172.21.15.86:6814/96739,v1:172.21.15.86:6816/96739] conn(0x7f0f70070ba0 0x7f0f70072fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:19.537 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.475+0000 7f0f7effd700 1 -- 172.21.15.86:0/643381663 --> [v2:172.21.15.86:6814/96739,v1:172.21.15.86:6816/96739] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0f70073660 con 0x7f0f70070ba0 2023-03-06T13:49:19.537 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.475+0000 7f0f7effd700 1 -- 172.21.15.86:0/643381663 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0f88086790 con 0x7f0f900bb9d0 2023-03-06T13:49:19.537 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.475+0000 7fd48affd700 1 -- 172.21.15.86:0/2038763101 <== mon.2 v2:172.21.15.202:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4900137e0 con 0x7fd49c0c11f0 2023-03-06T13:49:19.537 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.475+0000 7fd48affd700 1 -- 172.21.15.86:0/2038763101 <== mon.2 v2:172.21.15.202:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd490013b70 con 0x7fd49c0c11f0 2023-03-06T13:49:19.537 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.475+0000 7fd4a0fd8700 1 -- 172.21.15.86:0/2038763101 --> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd49c152f30 con 0x7fd49c0c11f0 2023-03-06T13:49:19.538 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.476+0000 7fd4a0fd8700 1 -- 172.21.15.86:0/2038763101 --> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd49c152c50 con 0x7fd49c0c11f0 2023-03-06T13:49:19.538 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.476+0000 7f0f8dd9b700 1 --2- 172.21.15.86:0/643381663 >> [v2:172.21.15.86:6814/96739,v1:172.21.15.86:6816/96739] conn(0x7f0f70070ba0 0x7f0f70072fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:19.538 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.476+0000 7f0f8e59c700 1 --2- 172.21.15.86:0/643381663 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7f0f700682f0 0x7f0f7006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:19.538 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.476+0000 7f0f8dd9b700 1 --2- 172.21.15.86:0/643381663 >> [v2:172.21.15.86:6814/96739,v1:172.21.15.86:6816/96739] conn(0x7f0f70070ba0 0x7f0f70072fb0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T13:49:19.539 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.476+0000 7f0f8e59c700 1 --2- 172.21.15.86:0/643381663 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7f0f700682f0 0x7f0f7006a7a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f0f80007fd0 tx=0x7f0f80009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T13:49:19.539 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.477+0000 7fd4a0fd8700 1 -- 172.21.15.86:0/2038763101 --> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd49c153210 con 0x7fd49c0c11f0 2023-03-06T13:49:19.539 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.477+0000 7f6bdeffd700 1 -- 172.21.15.86:0/2438423212 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f6be4019030 con 0x7f6bf00bc1f0 2023-03-06T13:49:19.540 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.477+0000 7f6bdeffd700 1 --2- 172.21.15.86:0/2438423212 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7f6bd00682f0 0x7f6bd006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:19.540 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.477+0000 7f6bdeffd700 1 -- 172.21.15.86:0/2438423212 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f6be40851b0 con 0x7f6bf00bc1f0 2023-03-06T13:49:19.540 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.477+0000 7f6bedd9b700 1 --2- 172.21.15.86:0/2438423212 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7f6bd00682f0 0x7f6bd006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:19.540 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.477+0000 7f42b9ffb700 1 -- 172.21.15.86:0/3654800486 <== osd.5 v2:172.21.15.202:6824/96848 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f42a80735e0 con 0x7f42a8070b20 2023-03-06T13:49:19.541 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.478+0000 7fd48affd700 1 -- 172.21.15.86:0/2038763101 <== mon.2 v2:172.21.15.202:3301/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fd490019030 con 0x7fd49c0c11f0 2023-03-06T13:49:19.541 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.478+0000 7fd48affd700 1 --2- 172.21.15.86:0/2038763101 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7fd47c068370 0x7fd47c06a820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:19.541 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.478+0000 7fd48affd700 1 -- 172.21.15.86:0/2038763101 <== mon.2 v2:172.21.15.202:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd490085d50 con 0x7fd49c0c11f0 2023-03-06T13:49:19.541 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.478+0000 7fd48affd700 1 --2- 172.21.15.86:0/2038763101 >> [v2:172.21.15.86:6824/96756,v1:172.21.15.86:6825/96756] conn(0x7fd47c070c20 0x7fd47c073030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:19.541 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.478+0000 7fd48affd700 1 -- 172.21.15.86:0/2038763101 --> [v2:172.21.15.86:6824/96756,v1:172.21.15.86:6825/96756] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd47c0736e0 con 0x7fd47c070c20 2023-03-06T13:49:19.542 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.478+0000 7fd48affd700 1 -- 172.21.15.86:0/2038763101 <== mon.2 v2:172.21.15.202:3301/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd490086150 con 0x7fd49c0c11f0 2023-03-06T13:49:19.542 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.479+0000 7fd49ad9d700 1 --2- 172.21.15.86:0/2038763101 >> [v2:172.21.15.86:6824/96756,v1:172.21.15.86:6825/96756] conn(0x7fd47c070c20 0x7fd47c073030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:19.542 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.479+0000 7fdb7d7fa700 1 -- 172.21.15.86:0/1113903194 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb6c011830 con 0x7fdb801461d0 2023-03-06T13:49:19.542 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.479+0000 7fdb7d7fa700 1 -- 172.21.15.86:0/1113903194 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb6c011990 con 0x7fdb801461d0 2023-03-06T13:49:19.543 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.479+0000 7fd499d9b700 1 --2- 172.21.15.86:0/2038763101 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7fd47c068370 0x7fd47c06a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:19.543 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.479+0000 7fd49ad9d700 1 --2- 172.21.15.86:0/2038763101 >> [v2:172.21.15.86:6824/96756,v1:172.21.15.86:6825/96756] conn(0x7fd47c070c20 0x7fd47c073030 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T13:49:19.543 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.479+0000 7fdb7d7fa700 1 -- 172.21.15.86:0/1113903194 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb6c011d20 con 0x7fdb801461d0 2023-03-06T13:49:19.543 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.479+0000 7fd499d9b700 1 --2- 172.21.15.86:0/2038763101 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7fd47c068370 0x7fd47c06a820 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fd49c08b820 tx=0x7fd48c008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T13:49:19.544 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.480+0000 7f0f7effd700 1 -- 172.21.15.86:0/643381663 <== osd.0 v2:172.21.15.86:6814/96739 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f0f70073660 con 0x7f0f70070ba0 2023-03-06T13:49:19.544 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.480+0000 7fd48affd700 1 -- 172.21.15.86:0/2038763101 <== osd.3 v2:172.21.15.86:6824/96756 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fd47c0736e0 con 0x7fd47c070c20 2023-03-06T13:49:19.544 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.481+0000 7fdb86d9c700 1 -- 172.21.15.86:0/1113903194 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb800bcae0 con 0x7fdb801461d0 2023-03-06T13:49:19.545 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.481+0000 7fdb86d9c700 1 -- 172.21.15.86:0/1113903194 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb801465a0 con 0x7fdb801461d0 2023-03-06T13:49:19.545 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.478+0000 7f6bedd9b700 1 --2- 172.21.15.86:0/2438423212 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7f6bd00682f0 0x7f6bd006a7a0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f6be0001a60 tx=0x7f6be00019b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T13:49:19.545 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.479+0000 7f6bf4e89700 1 --2- 172.21.15.86:0/2438423212 >> [v2:172.21.15.86:6800/96738,v1:172.21.15.86:6801/96738] conn(0x7f6bf0071f90 0x7f6bf00888b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:19.545 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.479+0000 7f6bf4e89700 1 -- 172.21.15.86:0/2438423212 --> [v2:172.21.15.86:6800/96738,v1:172.21.15.86:6801/96738] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6bf004e750 con 0x7f6bf0071f90 2023-03-06T13:49:19.546 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.481+0000 7fdb86d9c700 1 -- 172.21.15.86:0/1113903194 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fdb800722b0 con 0x7fdb801461d0 2023-03-06T13:49:19.546 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.483+0000 7f5aedf13700 1 Processor -- start 2023-03-06T13:49:19.547 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.483+0000 7f5aedf13700 1 -- start start 2023-03-06T13:49:19.547 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.484+0000 7f5aedf13700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f5ae80c2270 0x7f5ae8072120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:19.547 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.484+0000 7f5aedf13700 1 --2- >> v2:172.21.15.202:3300/0 conn(0x7f5ae80c0f60 0x7f5ae80c1390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:19.547 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.484+0000 7f5aedf13700 1 --2- >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f5ae814f580 0x7f5ae814fa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:19.547 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.484+0000 7f5aedf13700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ae80bcf00 con 0x7f5ae80c2270 2023-03-06T13:49:19.547 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.484+0000 7f5aedf13700 1 -- --> v2:172.21.15.202:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ae8072660 con 0x7f5ae80c0f60 2023-03-06T13:49:19.548 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.484+0000 7f5aedf13700 1 -- --> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ae80662d0 con 0x7f5ae814f580 2023-03-06T13:49:19.548 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.484+0000 7f5ae77fe700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f5ae80c2270 0x7f5ae8072120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:19.548 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.484+0000 7f5ae77fe700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f5ae80c2270 0x7f5ae8072120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:38842/0 (socket says 172.21.15.86:38842) 2023-03-06T13:49:19.548 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.484+0000 7f5ae77fe700 1 -- 172.21.15.86:0/1701048363 learned_addr learned my addr 172.21.15.86:0/1701048363 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-03-06T13:49:19.548 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.484+0000 7f5ae7fff700 1 --2- 172.21.15.86:0/1701048363 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f5ae814f580 0x7f5ae814fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:19.548 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.484+0000 7f5ae77fe700 1 -- 172.21.15.86:0/1701048363 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f5ae814f580 msgr2=0x7f5ae814fa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T13:49:19.548 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.484+0000 7f5ae77fe700 1 --2- 172.21.15.86:0/1701048363 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f5ae814f580 0x7f5ae814fa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:19.548 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.484+0000 7f5ae77fe700 1 -- 172.21.15.86:0/1701048363 >> v2:172.21.15.202:3300/0 conn(0x7f5ae80c0f60 msgr2=0x7f5ae80c1390 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-03-06T13:49:19.549 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.484+0000 7f5ae77fe700 1 --2- 172.21.15.86:0/1701048363 >> v2:172.21.15.202:3300/0 conn(0x7f5ae80c0f60 0x7f5ae80c1390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:19.549 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.484+0000 7f5ae77fe700 1 -- 172.21.15.86:0/1701048363 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ae80be0a0 con 0x7f5ae80c2270 2023-03-06T13:49:19.549 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.485+0000 7f5ae7fff700 1 --2- 172.21.15.86:0/1701048363 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f5ae814f580 0x7f5ae814fa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-06T13:49:19.549 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.485+0000 7f5ae77fe700 1 --2- 172.21.15.86:0/1701048363 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5ae80c2270 0x7f5ae8072120 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f5ae80bf440 tx=0x7f5ad8009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3552a0fe32457f10 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T13:49:19.549 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.488+0000 7f6beed9d700 1 --2- 172.21.15.86:0/2438423212 >> [v2:172.21.15.86:6800/96738,v1:172.21.15.86:6801/96738] conn(0x7f6bf0071f90 0x7f6bf00888b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:19.550 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.488+0000 7f6beed9d700 1 --2- 172.21.15.86:0/2438423212 >> [v2:172.21.15.86:6800/96738,v1:172.21.15.86:6801/96738] conn(0x7f6bf0071f90 0x7f6bf00888b0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T13:49:19.550 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.489+0000 7f6bdeffd700 1 -- 172.21.15.86:0/2438423212 <== osd.1 v2:172.21.15.86:6800/96738 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f6bf004e750 con 0x7f6bf0071f90 2023-03-06T13:49:19.550 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.491+0000 7fe0884b2700 1 -- 172.21.15.86:0/705016231 --> [v2:172.21.15.202:6808/96845,v1:172.21.15.202:6809/96845] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fe08004e750 con 0x7fe064070bf0 2023-03-06T13:49:19.550 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.491+0000 7fe076ffd700 1 -- 172.21.15.86:0/705016231 <== osd.6 v2:172.21.15.202:6808/96845 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fe08004e750 con 0x7fe064070bf0 2023-03-06T13:49:19.551 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.494+0000 7fdb7d7fa700 1 -- 172.21.15.86:0/1113903194 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fdb6c021070 con 0x7fdb801461d0 2023-03-06T13:49:19.551 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.494+0000 7fdb7d7fa700 1 --2- 172.21.15.86:0/1113903194 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7fdb640683c0 0x7fdb6406a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:19.551 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.494+0000 7fe0884b2700 1 -- 172.21.15.86:0/705016231 >> [v2:172.21.15.202:6808/96845,v1:172.21.15.202:6809/96845] conn(0x7fe064070bf0 msgr2=0x7fe064073000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:19.552 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.494+0000 7fe0884b2700 1 --2- 172.21.15.86:0/705016231 >> [v2:172.21.15.202:6808/96845,v1:172.21.15.202:6809/96845] conn(0x7fe064070bf0 0x7fe064073000 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:19.552 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.494+0000 7fdb7d7fa700 1 -- 172.21.15.86:0/1113903194 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fdb6c0863c0 con 0x7fdb801461d0 2023-03-06T13:49:19.552 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.494+0000 7fe0884b2700 1 -- 172.21.15.86:0/705016231 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7fe064068340 msgr2=0x7fe06406a7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:19.553 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.494+0000 7fe0884b2700 1 --2- 172.21.15.86:0/705016231 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7fe064068340 0x7fe06406a7f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fe07c009b90 tx=0x7fe07c008030 comp rx=0 tx=0).stop 2023-03-06T13:49:19.553 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.494+0000 7fe0884b2700 1 -- 172.21.15.86:0/705016231 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7fe0800bb9d0 msgr2=0x7fe080136d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:19.553 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.494+0000 7fe0884b2700 1 --2- 172.21.15.86:0/705016231 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7fe0800bb9d0 0x7fe080136d70 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fe07800cad0 tx=0x7fe07800ce90 comp rx=0 tx=0).stop 2023-03-06T13:49:19.553 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.494+0000 7fe086a4f700 1 -- 172.21.15.86:0/705016231 reap_dead start 2023-03-06T13:49:19.553 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.494+0000 7fdb7d7fa700 1 --2- 172.21.15.86:0/1113903194 >> [v2:172.21.15.202:6816/96847,v1:172.21.15.202:6817/96847] conn(0x7fdb64070c70 0x7fdb64073080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:19.554 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.494+0000 7fdb7d7fa700 1 -- 172.21.15.86:0/1113903194 --> [v2:172.21.15.202:6816/96847,v1:172.21.15.202:6817/96847] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fdb64073730 con 0x7fdb64070c70 2023-03-06T13:49:19.554 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.494+0000 7fdb7d7fa700 1 -- 172.21.15.86:0/1113903194 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdb6c086770 con 0x7fdb801461d0 2023-03-06T13:49:19.554 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.495+0000 7fe0884b2700 1 -- 172.21.15.86:0/705016231 shutdown_connections 2023-03-06T13:49:19.554 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.495+0000 7fe0884b2700 1 -- 172.21.15.86:0/705016231 >> 172.21.15.86:0/705016231 conn(0x7fe08006afc0 msgr2=0x7fe0800b93c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T13:49:19.554 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.495+0000 7fe0884b2700 1 -- 172.21.15.86:0/705016231 shutdown_connections 2023-03-06T13:49:19.555 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.495+0000 7fe0884b2700 1 -- 172.21.15.86:0/705016231 wait complete. 2023-03-06T13:49:19.555 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.495+0000 7fdb84b38700 1 --2- 172.21.15.86:0/1113903194 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7fdb640683c0 0x7fdb6406a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:19.555 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.495+0000 7fdb84b38700 1 --2- 172.21.15.86:0/1113903194 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7fdb640683c0 0x7fdb6406a870 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fdb74000c00 tx=0x7fdb74012000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T13:49:19.555 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.497+0000 7fdb85339700 1 --2- 172.21.15.86:0/1113903194 >> [v2:172.21.15.202:6816/96847,v1:172.21.15.202:6817/96847] conn(0x7fdb64070c70 0x7fdb64073080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:19.556 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.497+0000 7fdb85339700 1 --2- 172.21.15.86:0/1113903194 >> [v2:172.21.15.202:6816/96847,v1:172.21.15.202:6817/96847] conn(0x7fdb64070c70 0x7fdb64073080 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T13:49:19.556 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.498+0000 7fdb7d7fa700 1 -- 172.21.15.86:0/1113903194 <== osd.4 v2:172.21.15.202:6816/96847 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fdb64073730 con 0x7fdb64070c70 2023-03-06T13:49:19.556 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.502+0000 7f5ae67fc700 1 -- 172.21.15.86:0/1701048363 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ad800b870 con 0x7f5ae80c2270 2023-03-06T13:49:19.556 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.502+0000 7f5ae67fc700 1 -- 172.21.15.86:0/1701048363 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ad800b9d0 con 0x7f5ae80c2270 2023-03-06T13:49:19.556 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.502+0000 7f5ae67fc700 1 -- 172.21.15.86:0/1701048363 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ad800bd60 con 0x7f5ae80c2270 2023-03-06T13:49:19.557 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.503+0000 7f5aedf13700 1 -- 172.21.15.86:0/1701048363 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5ae80c2270 msgr2=0x7f5ae8072120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:19.557 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.503+0000 7f5aedf13700 1 --2- 172.21.15.86:0/1701048363 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5ae80c2270 0x7f5ae8072120 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f5ae80bf440 tx=0x7f5ad8009bd0 comp rx=0 tx=0).stop 2023-03-06T13:49:19.557 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.504+0000 7f5aedf13700 1 -- 172.21.15.86:0/1701048363 shutdown_connections 2023-03-06T13:49:19.557 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.504+0000 7f5aedf13700 1 --2- 172.21.15.86:0/1701048363 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f5ae814f580 0x7f5ae814fa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:19.557 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.504+0000 7f5aedf13700 1 --2- 172.21.15.86:0/1701048363 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5ae80c2270 0x7f5ae8072120 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:19.557 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.504+0000 7f5aedf13700 1 --2- 172.21.15.86:0/1701048363 >> v2:172.21.15.202:3300/0 conn(0x7f5ae80c0f60 0x7f5ae80c1390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:19.557 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.504+0000 7f5aedf13700 1 -- 172.21.15.86:0/1701048363 >> 172.21.15.86:0/1701048363 conn(0x7f5ae80a4180 msgr2=0x7f5ae80c18f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T13:49:19.558 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.504+0000 7ff3a1ea1700 1 -- 172.21.15.86:0/996205330 --> [v2:172.21.15.86:6808/96740,v1:172.21.15.86:6809/96740] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7ff37c002d30 con 0x7ff388070bf0 2023-03-06T13:49:19.558 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.506+0000 7ff383fff700 1 -- 172.21.15.86:0/996205330 <== osd.2 v2:172.21.15.86:6808/96740 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7ff37c002d30 con 0x7ff388070bf0 2023-03-06T13:49:19.558 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.507+0000 7f6bf4e89700 1 -- 172.21.15.86:0/2438423212 --> [v2:172.21.15.86:6800/96738,v1:172.21.15.86:6801/96738] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f6bf00b80e0 con 0x7f6bf0071f90 2023-03-06T13:49:19.559 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.508+0000 7f6bdeffd700 1 -- 172.21.15.86:0/2438423212 <== osd.1 v2:172.21.15.86:6800/96738 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f6bf00b80e0 con 0x7f6bf0071f90 2023-03-06T13:49:19.559 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.508+0000 7ff3a1ea1700 1 -- 172.21.15.86:0/996205330 >> [v2:172.21.15.86:6808/96740,v1:172.21.15.86:6809/96740] conn(0x7ff388070bf0 msgr2=0x7ff388073000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:19.559 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.508+0000 7ff3a1ea1700 1 --2- 172.21.15.86:0/996205330 >> [v2:172.21.15.86:6808/96740,v1:172.21.15.86:6809/96740] conn(0x7ff388070bf0 0x7ff388073000 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:19.560 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.508+0000 7ff3a1ea1700 1 -- 172.21.15.86:0/996205330 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7ff388068340 msgr2=0x7ff38806a7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:19.560 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.508+0000 7ff3a1ea1700 1 --2- 172.21.15.86:0/996205330 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7ff388068340 0x7ff38806a7f0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7ff39c1fdbc0 tx=0x7ff39400f000 comp rx=0 tx=0).stop 2023-03-06T13:49:19.560 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.508+0000 7ff3a1ea1700 1 -- 172.21.15.86:0/996205330 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7ff39c0c19d0 msgr2=0x7ff39c099cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:19.560 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.508+0000 7ff3a1ea1700 1 --2- 172.21.15.86:0/996205330 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7ff39c0c19d0 0x7ff39c099cb0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7ff38c000f60 tx=0x7ff38c00c790 comp rx=0 tx=0).stop 2023-03-06T13:49:19.560 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.504+0000 7f5aedf13700 1 -- 172.21.15.86:0/1701048363 shutdown_connections 2023-03-06T13:49:19.561 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.504+0000 7f5aedf13700 1 -- 172.21.15.86:0/1701048363 wait complete. 2023-03-06T13:49:19.561 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.506+0000 7f5aedf13700 1 Processor -- start 2023-03-06T13:49:19.561 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.506+0000 7f5aedf13700 1 -- start start 2023-03-06T13:49:19.561 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.507+0000 7f5aedf13700 1 --2- >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f5ae80c0f60 0x7f5ae80b8560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:19.561 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.507+0000 7f5aedf13700 1 --2- >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f5ae80c2270 0x7f5ae8144d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:19.561 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.507+0000 7f5aedf13700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5ae814f580 0x7f5ae8071500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:19.561 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.507+0000 7f5aedf13700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ae813ba40 con 0x7f5ae814f580 2023-03-06T13:49:19.562 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.507+0000 7f5aedf13700 1 -- --> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ae814dba0 con 0x7f5ae80c0f60 2023-03-06T13:49:19.562 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.507+0000 7f5aedf13700 1 -- --> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ae813b480 con 0x7f5ae80c2270 2023-03-06T13:49:19.562 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.507+0000 7f5ae77fe700 1 --2- >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f5ae80c0f60 0x7f5ae80b8560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:19.562 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.508+0000 7f5ae77fe700 1 --2- >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f5ae80c0f60 0x7f5ae80b8560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.202:3300/0 says I am v2:172.21.15.86:44384/0 (socket says 172.21.15.86:44384) 2023-03-06T13:49:19.562 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.508+0000 7f5ae77fe700 1 -- 172.21.15.86:0/1799367147 learned_addr learned my addr 172.21.15.86:0/1799367147 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-03-06T13:49:19.562 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.508+0000 7f5ae7fff700 1 --2- 172.21.15.86:0/1799367147 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5ae814f580 0x7f5ae8071500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:19.562 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.508+0000 7f5ae6ffd700 1 --2- 172.21.15.86:0/1799367147 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f5ae80c2270 0x7f5ae8144d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:19.563 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.508+0000 7f5ae7fff700 1 -- 172.21.15.86:0/1799367147 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f5ae80c2270 msgr2=0x7f5ae8144d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:19.563 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.508+0000 7f5ae7fff700 1 --2- 172.21.15.86:0/1799367147 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f5ae80c2270 0x7f5ae8144d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:19.563 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.508+0000 7f5ae7fff700 1 -- 172.21.15.86:0/1799367147 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f5ae80c0f60 msgr2=0x7f5ae80b8560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:19.563 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.508+0000 7f5ae7fff700 1 --2- 172.21.15.86:0/1799367147 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f5ae80c0f60 0x7f5ae80b8560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:19.563 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.508+0000 7f5ae7fff700 1 -- 172.21.15.86:0/1799367147 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ad8009550 con 0x7f5ae814f580 2023-03-06T13:49:19.563 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.508+0000 7f5ae7fff700 1 --2- 172.21.15.86:0/1799367147 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5ae814f580 0x7f5ae8071500 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f5ae0007d40 tx=0x7f5ae000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T13:49:19.563 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.509+0000 7f5acffff700 1 -- 172.21.15.86:0/1799367147 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ae000ddd0 con 0x7f5ae814f580 2023-03-06T13:49:19.563 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.509+0000 7f5acffff700 1 -- 172.21.15.86:0/1799367147 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ae000f040 con 0x7f5ae814f580 2023-03-06T13:49:19.564 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.509+0000 7f5acffff700 1 -- 172.21.15.86:0/1799367147 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ae0003c40 con 0x7f5ae814f580 2023-03-06T13:49:19.564 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.509+0000 7f5aedf13700 1 -- 172.21.15.86:0/1799367147 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ae814c340 con 0x7f5ae814f580 2023-03-06T13:49:19.564 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.509+0000 7f5aedf13700 1 -- 172.21.15.86:0/1799367147 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ae8072890 con 0x7f5ae814f580 2023-03-06T13:49:19.564 INFO:teuthology.orchestra.run.smithi086.stdout:55834574855 2023-03-06T13:49:19.565 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-03-06T13:49:19.565 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.511+0000 7f6bf4e89700 1 -- 172.21.15.86:0/2438423212 >> [v2:172.21.15.86:6800/96738,v1:172.21.15.86:6801/96738] conn(0x7f6bf0071f90 msgr2=0x7f6bf00888b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:19.566 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.511+0000 7f6bf4e89700 1 --2- 172.21.15.86:0/2438423212 >> [v2:172.21.15.86:6800/96738,v1:172.21.15.86:6801/96738] conn(0x7f6bf0071f90 0x7f6bf00888b0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:19.566 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.511+0000 7f42cb705700 1 -- 172.21.15.86:0/3654800486 --> [v2:172.21.15.202:6824/96848,v1:172.21.15.202:6825/96848] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f42c41495f0 con 0x7f42a8070b20 2023-03-06T13:49:19.566 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.511+0000 7f5aedf13700 1 -- 172.21.15.86:0/1799367147 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f5ae814c620 con 0x7f5ae814f580 2023-03-06T13:49:19.567 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.511+0000 7f6bf4e89700 1 -- 172.21.15.86:0/2438423212 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7f6bd00682f0 msgr2=0x7f6bd006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:19.567 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.511+0000 7f6bf4e89700 1 --2- 172.21.15.86:0/2438423212 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7f6bd00682f0 0x7f6bd006a7a0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f6be0001a60 tx=0x7f6be00019b0 comp rx=0 tx=0).stop 2023-03-06T13:49:19.567 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.511+0000 7f6bf4e89700 1 -- 172.21.15.86:0/2438423212 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6bf00bc1f0 msgr2=0x7f6bf015e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:19.567 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.511+0000 7f6bf4e89700 1 --2- 172.21.15.86:0/2438423212 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6bf00bc1f0 0x7f6bf015e000 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f6be400c780 tx=0x7f6be400ca90 comp rx=0 tx=0).stop 2023-03-06T13:49:19.567 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.511+0000 7f6beed9d700 1 -- 172.21.15.86:0/2438423212 reap_dead start 2023-03-06T13:49:19.567 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.511+0000 7f6bf4e89700 1 -- 172.21.15.86:0/2438423212 shutdown_connections 2023-03-06T13:49:19.568 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.511+0000 7f6bf4e89700 1 -- 172.21.15.86:0/2438423212 >> 172.21.15.86:0/2438423212 conn(0x7f6bf006afc0 msgr2=0x7f6bf015bed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T13:49:19.568 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.511+0000 7ff39bfff700 1 -- 172.21.15.86:0/996205330 reap_dead start 2023-03-06T13:49:19.568 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.511+0000 7ff3a1ea1700 1 -- 172.21.15.86:0/996205330 shutdown_connections 2023-03-06T13:49:19.568 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.511+0000 7ff3a1ea1700 1 -- 172.21.15.86:0/996205330 >> 172.21.15.86:0/996205330 conn(0x7ff39c06afc0 msgr2=0x7ff39c0c0f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T13:49:19.569 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.511+0000 7f6bf4e89700 1 -- 172.21.15.86:0/2438423212 shutdown_connections 2023-03-06T13:49:19.569 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.511+0000 7f6bf4e89700 1 -- 172.21.15.86:0/2438423212 wait complete. 2023-03-06T13:49:19.569 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.511+0000 7fd4a0fd8700 1 -- 172.21.15.86:0/2038763101 --> [v2:172.21.15.86:6824/96756,v1:172.21.15.86:6825/96756] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fd49c1e91e0 con 0x7fd47c070c20 2023-03-06T13:49:19.569 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.511+0000 7f5acffff700 1 -- 172.21.15.86:0/1799367147 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f5ae001c030 con 0x7f5ae814f580 2023-03-06T13:49:19.570 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.512+0000 7fd48affd700 1 -- 172.21.15.86:0/2038763101 <== osd.3 v2:172.21.15.86:6824/96756 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fd49c1e91e0 con 0x7fd47c070c20 2023-03-06T13:49:19.570 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.512+0000 7f5acffff700 1 --2- 172.21.15.86:0/1799367147 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7f5ad006c8a0 0x7f5ad006ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:19.571 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.512+0000 7f5acffff700 1 -- 172.21.15.86:0/1799367147 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5ae0085a90 con 0x7f5ae814f580 2023-03-06T13:49:19.571 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.512+0000 7f5ae77fe700 1 --2- 172.21.15.86:0/1799367147 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7f5ad006c8a0 0x7f5ad006ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:19.571 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.512+0000 7f5acffff700 1 --2- 172.21.15.86:0/1799367147 >> [v2:172.21.15.202:6800/96846,v1:172.21.15.202:6801/96846] conn(0x7f5ad00750d0 0x7f5ad00774e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:19.571 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.512+0000 7f5acffff700 1 -- 172.21.15.86:0/1799367147 --> [v2:172.21.15.202:6800/96846,v1:172.21.15.202:6801/96846] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5ad0077b90 con 0x7f5ad00750d0 2023-03-06T13:49:19.571 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.512+0000 7f5acffff700 1 -- 172.21.15.86:0/1799367147 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5ae008a2a0 con 0x7f5ae814f580 2023-03-06T13:49:19.572 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.512+0000 7fd4a0fd8700 1 -- 172.21.15.86:0/2038763101 >> [v2:172.21.15.86:6824/96756,v1:172.21.15.86:6825/96756] conn(0x7fd47c070c20 msgr2=0x7fd47c073030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:19.572 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.512+0000 7fd4a0fd8700 1 --2- 172.21.15.86:0/2038763101 >> [v2:172.21.15.86:6824/96756,v1:172.21.15.86:6825/96756] conn(0x7fd47c070c20 0x7fd47c073030 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:19.572 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.512+0000 7fd4a0fd8700 1 -- 172.21.15.86:0/2038763101 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7fd47c068370 msgr2=0x7fd47c06a820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:19.572 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.512+0000 7fd4a0fd8700 1 --2- 172.21.15.86:0/2038763101 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7fd47c068370 0x7fd47c06a820 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fd49c08b820 tx=0x7fd48c008030 comp rx=0 tx=0).stop 2023-03-06T13:49:19.572 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.512+0000 7fd4a0fd8700 1 -- 172.21.15.86:0/2038763101 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fd49c0c11f0 msgr2=0x7fd49c0beb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:19.572 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.512+0000 7fd4a0fd8700 1 --2- 172.21.15.86:0/2038763101 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fd49c0c11f0 0x7fd49c0beb60 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fd49000e8b0 tx=0x7fd49000ebc0 comp rx=0 tx=0).stop 2023-03-06T13:49:19.573 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.512+0000 7f5ae6ffd700 1 --2- 172.21.15.86:0/1799367147 >> [v2:172.21.15.202:6800/96846,v1:172.21.15.202:6801/96846] conn(0x7f5ad00750d0 0x7f5ad00774e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:19.573 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.512+0000 7fd49ad9d700 1 -- 172.21.15.86:0/2038763101 reap_dead start 2023-03-06T13:49:19.573 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.513+0000 7fd4a0fd8700 1 -- 172.21.15.86:0/2038763101 shutdown_connections 2023-03-06T13:49:19.573 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.513+0000 7fd4a0fd8700 1 -- 172.21.15.86:0/2038763101 >> 172.21.15.86:0/2038763101 conn(0x7fd49c071a60 msgr2=0x7fd49c0a5f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T13:49:19.574 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.513+0000 7f5ae77fe700 1 --2- 172.21.15.86:0/1799367147 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7f5ad006c8a0 0x7f5ad006ed50 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f5ad8009c10 tx=0x7f5ad801d040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T13:49:19.574 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.513+0000 7fd4a0fd8700 1 -- 172.21.15.86:0/2038763101 shutdown_connections 2023-03-06T13:49:19.574 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.513+0000 7fd4a0fd8700 1 -- 172.21.15.86:0/2038763101 wait complete. 2023-03-06T13:49:19.575 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.513+0000 7ff3a1ea1700 1 -- 172.21.15.86:0/996205330 shutdown_connections 2023-03-06T13:49:19.575 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.513+0000 7f5ae6ffd700 1 --2- 172.21.15.86:0/1799367147 >> [v2:172.21.15.202:6800/96846,v1:172.21.15.202:6801/96846] conn(0x7f5ad00750d0 0x7f5ad00774e0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T13:49:19.575 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.513+0000 7f0f94d51700 1 -- 172.21.15.86:0/643381663 --> [v2:172.21.15.86:6814/96739,v1:172.21.15.86:6816/96739] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f0f9004e750 con 0x7f0f70070ba0 2023-03-06T13:49:19.575 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.513+0000 7ff3a1ea1700 1 -- 172.21.15.86:0/996205330 wait complete. 2023-03-06T13:49:19.576 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.513+0000 7f0f7effd700 1 -- 172.21.15.86:0/643381663 <== osd.0 v2:172.21.15.86:6814/96739 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f0f9004e750 con 0x7f0f70070ba0 2023-03-06T13:49:19.576 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.514+0000 7f42b9ffb700 1 -- 172.21.15.86:0/3654800486 <== osd.5 v2:172.21.15.202:6824/96848 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f42c41495f0 con 0x7f42a8070b20 2023-03-06T13:49:19.577 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.514+0000 7f0f94d51700 1 -- 172.21.15.86:0/643381663 >> [v2:172.21.15.86:6814/96739,v1:172.21.15.86:6816/96739] conn(0x7f0f70070ba0 msgr2=0x7f0f70072fb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:19.577 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.514+0000 7f0f94d51700 1 --2- 172.21.15.86:0/643381663 >> [v2:172.21.15.86:6814/96739,v1:172.21.15.86:6816/96739] conn(0x7f0f70070ba0 0x7f0f70072fb0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:19.577 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.514+0000 7f5acffff700 1 -- 172.21.15.86:0/1799367147 <== osd.7 v2:172.21.15.202:6800/96846 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f5ad0077b90 con 0x7f5ad00750d0 2023-03-06T13:49:19.578 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.514+0000 7f0f94d51700 1 -- 172.21.15.86:0/643381663 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7f0f700682f0 msgr2=0x7f0f7006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:19.578 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.514+0000 7f0f94d51700 1 --2- 172.21.15.86:0/643381663 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7f0f700682f0 0x7f0f7006a7a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f0f80007fd0 tx=0x7f0f80009040 comp rx=0 tx=0).stop 2023-03-06T13:49:19.578 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.514+0000 7f0f94d51700 1 -- 172.21.15.86:0/643381663 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0f900bb9d0 msgr2=0x7f0f900c0810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:19.578 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.514+0000 7f0f94d51700 1 --2- 172.21.15.86:0/643381663 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0f900bb9d0 0x7f0f900c0810 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f0f8800be80 tx=0x7f0f88009ed0 comp rx=0 tx=0).stop 2023-03-06T13:49:19.578 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.514+0000 7f0f8ed9d700 1 -- 172.21.15.86:0/643381663 reap_dead start 2023-03-06T13:49:19.578 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.514+0000 7f0f94d51700 1 -- 172.21.15.86:0/643381663 shutdown_connections 2023-03-06T13:49:19.578 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.514+0000 7f0f94d51700 1 -- 172.21.15.86:0/643381663 >> 172.21.15.86:0/643381663 conn(0x7f0f9006afc0 msgr2=0x7f0f900b9f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T13:49:19.579 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.514+0000 7f0f94d51700 1 -- 172.21.15.86:0/643381663 shutdown_connections 2023-03-06T13:49:19.579 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.514+0000 7f0f94d51700 1 -- 172.21.15.86:0/643381663 wait complete. 2023-03-06T13:49:19.579 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.515+0000 7f42cb705700 1 -- 172.21.15.86:0/3654800486 >> [v2:172.21.15.202:6824/96848,v1:172.21.15.202:6825/96848] conn(0x7f42a8070b20 msgr2=0x7f42a8072f30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:19.579 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.515+0000 7f42cb705700 1 --2- 172.21.15.86:0/3654800486 >> [v2:172.21.15.202:6824/96848,v1:172.21.15.202:6825/96848] conn(0x7f42a8070b20 0x7f42a8072f30 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:19.579 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.515+0000 7f42cb705700 1 -- 172.21.15.86:0/3654800486 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7f42a80682f0 msgr2=0x7f42a806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:19.579 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.515+0000 7f42cb705700 1 --2- 172.21.15.86:0/3654800486 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7f42a80682f0 0x7f42a806a7a0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f42bc014040 tx=0x7f42bc01d040 comp rx=0 tx=0).stop 2023-03-06T13:49:19.580 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.515+0000 7f42cb705700 1 -- 172.21.15.86:0/3654800486 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f42b0004850 msgr2=0x7f42c4159440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:19.580 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.515+0000 7f42cb705700 1 --2- 172.21.15.86:0/3654800486 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f42b0004850 0x7f42c4159440 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f42c000f9a0 tx=0x7f42c000fd60 comp rx=0 tx=0).stop 2023-03-06T13:49:19.580 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.515+0000 7f42c9ca2700 1 -- 172.21.15.86:0/3654800486 reap_dead start 2023-03-06T13:49:19.580 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.515+0000 7f42cb705700 1 -- 172.21.15.86:0/3654800486 shutdown_connections 2023-03-06T13:49:19.580 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.515+0000 7f42cb705700 1 -- 172.21.15.86:0/3654800486 >> 172.21.15.86:0/3654800486 conn(0x7f42c40a4180 msgr2=0x7f42c40a6330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T13:49:19.580 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.522+0000 7f42cb705700 1 -- 172.21.15.86:0/3654800486 shutdown_connections 2023-03-06T13:49:19.580 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.522+0000 7f42cb705700 1 -- 172.21.15.86:0/3654800486 wait complete. 2023-03-06T13:49:19.581 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.531+0000 7f5aedf13700 1 -- 172.21.15.86:0/1799367147 --> [v2:172.21.15.202:6800/96846,v1:172.21.15.202:6801/96846] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f5ae804e750 con 0x7f5ad00750d0 2023-03-06T13:49:19.581 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.533+0000 7f5acffff700 1 -- 172.21.15.86:0/1799367147 <== osd.7 v2:172.21.15.202:6800/96846 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f5ae804e750 con 0x7f5ad00750d0 2023-03-06T13:49:19.582 INFO:teuthology.orchestra.run.smithi086.stdout:55834574853 2023-03-06T13:49:19.582 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-03-06T13:49:19.583 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.533+0000 7f5aedf13700 1 -- 172.21.15.86:0/1799367147 >> [v2:172.21.15.202:6800/96846,v1:172.21.15.202:6801/96846] conn(0x7f5ad00750d0 msgr2=0x7f5ad00774e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:19.583 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.533+0000 7f5aedf13700 1 --2- 172.21.15.86:0/1799367147 >> [v2:172.21.15.202:6800/96846,v1:172.21.15.202:6801/96846] conn(0x7f5ad00750d0 0x7f5ad00774e0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:19.583 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.533+0000 7fdb86d9c700 1 -- 172.21.15.86:0/1113903194 --> [v2:172.21.15.202:6816/96847,v1:172.21.15.202:6817/96847] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fdb8004e750 con 0x7fdb64070c70 2023-03-06T13:49:19.584 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.534+0000 7f5aedf13700 1 -- 172.21.15.86:0/1799367147 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7f5ad006c8a0 msgr2=0x7f5ad006ed50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:19.584 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.534+0000 7f5aedf13700 1 --2- 172.21.15.86:0/1799367147 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7f5ad006c8a0 0x7f5ad006ed50 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f5ad8009c10 tx=0x7f5ad801d040 comp rx=0 tx=0).stop 2023-03-06T13:49:19.584 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.534+0000 7f5aedf13700 1 -- 172.21.15.86:0/1799367147 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5ae814f580 msgr2=0x7f5ae8071500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:19.584 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.534+0000 7f5aedf13700 1 --2- 172.21.15.86:0/1799367147 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5ae814f580 0x7f5ae8071500 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f5ae0007d40 tx=0x7f5ae000d3b0 comp rx=0 tx=0).stop 2023-03-06T13:49:19.585 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.534+0000 7f5ae7fff700 1 -- 172.21.15.86:0/1799367147 reap_dead start 2023-03-06T13:49:19.585 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.534+0000 7f5aedf13700 1 -- 172.21.15.86:0/1799367147 shutdown_connections 2023-03-06T13:49:19.585 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.534+0000 7f5aedf13700 1 -- 172.21.15.86:0/1799367147 >> 172.21.15.86:0/1799367147 conn(0x7f5ae80a4180 msgr2=0x7f5ae80a1870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T13:49:19.585 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.534+0000 7f5aedf13700 1 -- 172.21.15.86:0/1799367147 shutdown_connections 2023-03-06T13:49:19.585 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.534+0000 7f5aedf13700 1 -- 172.21.15.86:0/1799367147 wait complete. 2023-03-06T13:49:19.585 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.534+0000 7fdb7d7fa700 1 -- 172.21.15.86:0/1113903194 <== osd.4 v2:172.21.15.202:6816/96847 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fdb8004e750 con 0x7fdb64070c70 2023-03-06T13:49:19.586 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.535+0000 7fdb86d9c700 1 -- 172.21.15.86:0/1113903194 >> [v2:172.21.15.202:6816/96847,v1:172.21.15.202:6817/96847] conn(0x7fdb64070c70 msgr2=0x7fdb64073080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:19.586 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.535+0000 7fdb86d9c700 1 --2- 172.21.15.86:0/1113903194 >> [v2:172.21.15.202:6816/96847,v1:172.21.15.202:6817/96847] conn(0x7fdb64070c70 0x7fdb64073080 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:19.587 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.535+0000 7fdb86d9c700 1 -- 172.21.15.86:0/1113903194 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7fdb640683c0 msgr2=0x7fdb6406a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:19.587 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.535+0000 7fdb86d9c700 1 --2- 172.21.15.86:0/1113903194 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7fdb640683c0 0x7fdb6406a870 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fdb74000c00 tx=0x7fdb74012000 comp rx=0 tx=0).stop 2023-03-06T13:49:19.587 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.535+0000 7fdb86d9c700 1 -- 172.21.15.86:0/1113903194 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdb801461d0 msgr2=0x7fdb801eb960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:19.587 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.535+0000 7fdb86d9c700 1 --2- 172.21.15.86:0/1113903194 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdb801461d0 0x7fdb801eb960 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fdb6c00b530 tx=0x7fdb6c00b840 comp rx=0 tx=0).stop 2023-03-06T13:49:19.587 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.535+0000 7fdb85339700 1 -- 172.21.15.86:0/1113903194 reap_dead start 2023-03-06T13:49:19.587 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.535+0000 7fdb86d9c700 1 -- 172.21.15.86:0/1113903194 shutdown_connections 2023-03-06T13:49:19.587 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.535+0000 7fdb86d9c700 1 -- 172.21.15.86:0/1113903194 >> 172.21.15.86:0/1113903194 conn(0x7fdb8006b440 msgr2=0x7fdb800bd960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T13:49:19.587 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.535+0000 7fdb86d9c700 1 -- 172.21.15.86:0/1113903194 shutdown_connections 2023-03-06T13:49:19.588 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.535+0000 7fdb86d9c700 1 -- 172.21.15.86:0/1113903194 wait complete. 2023-03-06T13:49:19.588 INFO:teuthology.orchestra.run.smithi086.stdout:55834574855 2023-03-06T13:49:19.589 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-03-06T13:49:19.589 INFO:teuthology.orchestra.run.smithi086.stdout:55834574855 2023-03-06T13:49:19.590 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-03-06T13:49:19.591 INFO:teuthology.orchestra.run.smithi086.stdout:55834574855 2023-03-06T13:49:19.591 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-03-06T13:49:19.592 INFO:teuthology.orchestra.run.smithi086.stdout:55834574855 2023-03-06T13:49:19.592 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-03-06T13:49:19.593 INFO:teuthology.orchestra.run.smithi086.stdout:55834574854 2023-03-06T13:49:19.593 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-03-06T13:49:19.594 INFO:teuthology.orchestra.run.smithi086.stdout:55834574855 2023-03-06T13:49:19.594 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-03-06T13:49:19.830 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.828+0000 7fbc46d7a700 1 Processor -- start 2023-03-06T13:49:19.831 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.828+0000 7fbc46d7a700 1 -- start start 2023-03-06T13:49:19.831 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.829+0000 7fbc46d7a700 1 --2- >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fbc401543d0 0x7fbc400bf580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:19.831 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.829+0000 7fbc46d7a700 1 --2- >> v2:172.21.15.202:3300/0 conn(0x7fbc4006aa40 0x7fbc4015df10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:19.831 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.829+0000 7fbc46d7a700 1 -- --> v1:172.21.15.202:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc400bfac0 con 0x7fbc400bd940 2023-03-06T13:49:19.831 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.829+0000 7fbc46d7a700 1 -- --> v2:172.21.15.202:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc4006f0b0 con 0x7fbc4006aa40 2023-03-06T13:49:19.832 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.829+0000 7fbc46d7a700 1 -- --> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc40070850 con 0x7fbc401543d0 2023-03-06T13:49:19.832 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.829+0000 7fbc44b16700 1 --2- >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fbc401543d0 0x7fbc400bf580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:19.832 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.829+0000 7fbc44b16700 1 --2- >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fbc401543d0 0x7fbc400bf580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.202:3301/0 says I am v2:172.21.15.86:50558/0 (socket says 172.21.15.86:50558) 2023-03-06T13:49:19.832 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.829+0000 7fbc44b16700 1 -- 172.21.15.86:0/2846228665 learned_addr learned my addr 172.21.15.86:0/2846228665 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-03-06T13:49:19.832 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.830+0000 7fbc44b16700 1 -- 172.21.15.86:0/2846228665 >> v2:172.21.15.202:3300/0 conn(0x7fbc4006aa40 msgr2=0x7fbc4015df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T13:49:19.833 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.830+0000 7fbc44b16700 1 --2- 172.21.15.86:0/2846228665 >> v2:172.21.15.202:3300/0 conn(0x7fbc4006aa40 0x7fbc4015df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:19.833 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.830+0000 7fbc44b16700 1 -- 172.21.15.86:0/2846228665 >> v1:172.21.15.202:6789/0 conn(0x7fbc400bd940 legacy=0x7fbc4006a330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T13:49:19.833 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.830+0000 7fbc44b16700 1 -- 172.21.15.86:0/2846228665 --> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc4006e040 con 0x7fbc401543d0 2023-03-06T13:49:19.833 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.830+0000 7fbc44b16700 1 --2- 172.21.15.86:0/2846228665 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fbc401543d0 0x7fbc400bf580 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fbc38009e50 tx=0x7fbc3800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2d8cef9549573217 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T13:49:19.833 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.830+0000 7fbc3f7fe700 1 -- 172.21.15.86:0/2846228665 <== mon.2 v2:172.21.15.202:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc3800e070 con 0x7fbc401543d0 2023-03-06T13:49:19.833 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.830+0000 7fbc3f7fe700 1 -- 172.21.15.86:0/2846228665 <== mon.2 v2:172.21.15.202:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc38003a20 con 0x7fbc401543d0 2023-03-06T13:49:19.834 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.831+0000 7fbc46d7a700 1 -- 172.21.15.86:0/2846228665 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fbc401543d0 msgr2=0x7fbc400bf580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:19.834 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.831+0000 7fbc46d7a700 1 --2- 172.21.15.86:0/2846228665 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fbc401543d0 0x7fbc400bf580 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fbc38009e50 tx=0x7fbc3800b330 comp rx=0 tx=0).stop 2023-03-06T13:49:19.834 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.832+0000 7f5afc9f2700 1 Processor -- start 2023-03-06T13:49:19.835 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.833+0000 7f6033a05700 1 Processor -- start 2023-03-06T13:49:19.835 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.833+0000 7f5afc9f2700 1 -- start start 2023-03-06T13:49:19.835 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.833+0000 7fbc46d7a700 1 -- 172.21.15.86:0/2846228665 shutdown_connections 2023-03-06T13:49:19.836 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.833+0000 7fbc46d7a700 1 --2- 172.21.15.86:0/2846228665 >> v2:172.21.15.202:3300/0 conn(0x7fbc4006aa40 0x7fbc4015df10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:19.836 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.833+0000 7fbc46d7a700 1 --2- 172.21.15.86:0/2846228665 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fbc401543d0 0x7fbc400bf580 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:19.836 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.833+0000 7fbc46d7a700 1 -- 172.21.15.86:0/2846228665 >> 172.21.15.86:0/2846228665 conn(0x7fbc4006b440 msgr2=0x7fbc4006b840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T13:49:19.836 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.833+0000 7f6033a05700 1 -- start start 2023-03-06T13:49:19.837 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.834+0000 7f6033a05700 1 --2- >> v2:172.21.15.202:3300/0 conn(0x7f602c145510 0x7f602c14f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:19.837 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.834+0000 7f6033a05700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f602c0b5fd0 0x7f602c0bc930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:19.837 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.834+0000 7f6033a05700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f602c0bc4a0 con 0x7f602c0bd3f0 2023-03-06T13:49:19.837 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.834+0000 7f6033a05700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f602c0b7e40 con 0x7f602c0b5fd0 2023-03-06T13:49:19.837 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.834+0000 7f6033a05700 1 -- --> v2:172.21.15.202:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f602c14f6d0 con 0x7f602c145510 2023-03-06T13:49:19.838 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.833+0000 7f529a776700 1 Processor -- start 2023-03-06T13:49:19.838 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.834+0000 7f529a776700 1 -- start start 2023-03-06T13:49:19.838 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.834+0000 7f60317a1700 1 --2- >> v2:172.21.15.202:3300/0 conn(0x7f602c145510 0x7f602c14f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:19.839 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.834+0000 7f60317a1700 1 --2- >> v2:172.21.15.202:3300/0 conn(0x7f602c145510 0x7f602c14f0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.202:3300/0 says I am v2:172.21.15.86:44400/0 (socket says 172.21.15.86:44400) 2023-03-06T13:49:19.839 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.834+0000 7f60317a1700 1 -- 172.21.15.86:0/3585915167 learned_addr learned my addr 172.21.15.86:0/3585915167 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-03-06T13:49:19.839 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.835+0000 7f6030fa0700 1 --2- 172.21.15.86:0/3585915167 >> v2:172.21.15.86:3300/0 conn(0x7f602c0b5fd0 0x7f602c0bc930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:19.839 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.835+0000 7f529a776700 1 --2- >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f52940bd940 0x7f529406aa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:19.839 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.835+0000 7f529a776700 1 --2- >> v2:172.21.15.202:3300/0 conn(0x7f52940bf580 0x7f529415df10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:19.840 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.835+0000 7f529a776700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f529406e040 con 0x7f52941543d0 2023-03-06T13:49:19.840 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.835+0000 7f529a776700 1 -- --> v2:172.21.15.202:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f529406f0b0 con 0x7f52940bf580 2023-03-06T13:49:19.840 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.835+0000 7f529a776700 1 -- --> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5294070850 con 0x7f52940bd940 2023-03-06T13:49:19.840 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.834+0000 7f5afc9f2700 1 --2- >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f5af806ad10 0x7f5af81575a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:19.840 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.834+0000 7f5afc9f2700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5af80bf6f0 con 0x7f5af8157ae0 2023-03-06T13:49:19.841 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.835+0000 7f5afc9f2700 1 -- --> v1:172.21.15.202:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5af806b850 con 0x7f5af80c2270 2023-03-06T13:49:19.841 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.835+0000 7f5afc9f2700 1 -- --> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5af806baf0 con 0x7f5af806ad10 2023-03-06T13:49:19.841 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.835+0000 7f5af5d9b700 1 --2- >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f5af806ad10 0x7f5af81575a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:19.841 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.835+0000 7f5298d13700 1 --2- >> v2:172.21.15.202:3300/0 conn(0x7f52940bf580 0x7f529415df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:19.841 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.835+0000 7f5298d13700 1 --2- >> v2:172.21.15.202:3300/0 conn(0x7f52940bf580 0x7f529415df10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.202:3300/0 says I am v2:172.21.15.86:44414/0 (socket says 172.21.15.86:44414) 2023-03-06T13:49:19.842 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.835+0000 7f5298d13700 1 -- 172.21.15.86:0/3835097119 learned_addr learned my addr 172.21.15.86:0/3835097119 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-03-06T13:49:19.842 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.835+0000 7f52937fe700 1 --2- 172.21.15.86:0/3835097119 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f52940bd940 0x7f529406aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:19.842 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.835+0000 7f5af5d9b700 1 --2- >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f5af806ad10 0x7f5af81575a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.202:3301/0 says I am v2:172.21.15.86:50572/0 (socket says 172.21.15.86:50572) 2023-03-06T13:49:19.842 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.835+0000 7f5af5d9b700 1 -- 172.21.15.86:0/2414638559 learned_addr learned my addr 172.21.15.86:0/2414638559 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-03-06T13:49:19.842 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.835+0000 7f5af659c700 1 --1- >> v1:172.21.15.202:6789/0 conn(0x7f5af80c2270 0x7f5af80bc530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.202:6789/0 says I am v1:172.21.15.86:48080/0 (socket says 172.21.15.86:48080) 2023-03-06T13:49:19.843 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.835+0000 7f60317a1700 1 -- 172.21.15.86:0/3585915167 >> v2:172.21.15.86:3300/0 conn(0x7f602c0b5fd0 msgr2=0x7f602c0bc930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T13:49:19.843 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.835+0000 7f60317a1700 1 --2- 172.21.15.86:0/3585915167 >> v2:172.21.15.86:3300/0 conn(0x7f602c0b5fd0 0x7f602c0bc930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:19.843 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.835+0000 7f60317a1700 1 -- 172.21.15.86:0/3585915167 >> v1:172.21.15.86:6789/0 conn(0x7f602c0bd3f0 legacy=0x7f602c06c8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T13:49:19.843 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.835+0000 7f60317a1700 1 -- 172.21.15.86:0/3585915167 --> v2:172.21.15.202:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f602c1458e0 con 0x7f602c145510 2023-03-06T13:49:19.844 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.835+0000 7fddb7ed7700 1 Processor -- start 2023-03-06T13:49:19.844 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.835+0000 7f5298d13700 1 -- 172.21.15.86:0/3835097119 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f52940bd940 msgr2=0x7f529406aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T13:49:19.844 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.835+0000 7f5298d13700 1 --2- 172.21.15.86:0/3835097119 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f52940bd940 0x7f529406aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:19.844 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.835+0000 7f5298d13700 1 -- 172.21.15.86:0/3835097119 >> v1:172.21.15.86:6789/0 conn(0x7f52941543d0 legacy=0x7f529406a330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T13:49:19.845 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.835+0000 7f5298d13700 1 -- 172.21.15.86:0/3835097119 --> v2:172.21.15.202:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f529406e420 con 0x7f52940bf580 2023-03-06T13:49:19.845 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.835+0000 7f5af559a700 1 -- 172.21.15.86:0/2414638559 <== mon.1 v1:172.21.15.202:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2932474794 0 0) 0x7f5af806b850 con 0x7f5af80c2270 2023-03-06T13:49:19.845 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.835+0000 7f5af559a700 1 -- 172.21.15.86:0/2414638559 --> v1:172.21.15.202:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5ae00035b0 con 0x7f5af80c2270 2023-03-06T13:49:19.846 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.835+0000 7fddb7ed7700 1 -- start start 2023-03-06T13:49:19.846 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.835+0000 7f60317a1700 1 --2- 172.21.15.86:0/3585915167 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f602c145510 0x7f602c14f0f0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f602c06c2b0 tx=0x7f602400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=708ecb981b775da3 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T13:49:19.846 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.835+0000 7f5af5d9b700 1 -- 172.21.15.86:0/2414638559 >> v1:172.21.15.202:6789/0 conn(0x7f5af80c2270 legacy=0x7f5af80bc530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:19.847 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.835+0000 7f5af5d9b700 1 -- 172.21.15.86:0/2414638559 >> v1:172.21.15.86:6789/0 conn(0x7f5af8157ae0 legacy=0x7f5af815e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T13:49:19.847 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.835+0000 7f5af5d9b700 1 -- 172.21.15.86:0/2414638559 --> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5af806e360 con 0x7f5af806ad10 2023-03-06T13:49:19.847 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.836+0000 7f5298d13700 1 --2- 172.21.15.86:0/3835097119 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f52940bf580 0x7f529415df10 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f527c0098f0 tx=0x7f527c009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=deed47bf5c513103 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T13:49:19.847 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.836+0000 7f5af5d9b700 1 --2- 172.21.15.86:0/2414638559 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f5af806ad10 0x7f5af81575a0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f5aec0098f0 tx=0x7f5aec009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5ba8161601e508f9 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T13:49:19.848 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.836+0000 7fbc46d7a700 1 -- 172.21.15.86:0/2846228665 shutdown_connections 2023-03-06T13:49:19.848 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.836+0000 7f5292ffd700 1 -- 172.21.15.86:0/3835097119 <== mon.1 v2:172.21.15.202:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f527c004230 con 0x7f52940bf580 2023-03-06T13:49:19.848 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.836+0000 7f5292ffd700 1 -- 172.21.15.86:0/3835097119 <== mon.1 v2:172.21.15.202:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f527c004390 con 0x7f52940bf580 2023-03-06T13:49:19.848 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.836+0000 7f5292ffd700 1 -- 172.21.15.86:0/3835097119 <== mon.1 v2:172.21.15.202:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f527c0036a0 con 0x7f52940bf580 2023-03-06T13:49:19.849 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.837+0000 7f529a776700 1 -- 172.21.15.86:0/3835097119 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f52940bf580 msgr2=0x7f529415df10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:19.849 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.837+0000 7f529a776700 1 --2- 172.21.15.86:0/3835097119 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f52940bf580 0x7f529415df10 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f527c0098f0 tx=0x7f527c009c00 comp rx=0 tx=0).stop 2023-03-06T13:49:19.849 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.837+0000 7f529a776700 1 -- 172.21.15.86:0/3835097119 shutdown_connections 2023-03-06T13:49:19.849 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.837+0000 7f529a776700 1 --2- 172.21.15.86:0/3835097119 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f52940bf580 0x7f529415df10 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:19.849 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.837+0000 7f529a776700 1 --2- 172.21.15.86:0/3835097119 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f52940bd940 0x7f529406aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:19.850 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.837+0000 7f529a776700 1 -- 172.21.15.86:0/3835097119 >> 172.21.15.86:0/3835097119 conn(0x7f529406b440 msgr2=0x7f529406b840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T13:49:19.850 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.836+0000 7fddb7ed7700 1 --2- >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fddb00c29f0 0x7fddb00c4a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:19.850 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.836+0000 7fddb7ed7700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fddb00c4f80 0x7fddb00c53a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:19.850 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.836+0000 7fddb7ed7700 1 -- --> v1:172.21.15.202:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fddb00c0910 con 0x7fddb00c1f10 2023-03-06T13:49:19.850 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.836+0000 7fddb7ed7700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fddb00c1080 con 0x7fddb00c4f80 2023-03-06T13:49:19.851 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.836+0000 7fddb7ed7700 1 -- --> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddb00c0bf0 con 0x7fddb00c29f0 2023-03-06T13:49:19.851 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.837+0000 7fddb5c73700 1 --1- >> v1:172.21.15.202:6789/0 conn(0x7fddb00c1f10 0x7fddb00c22e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.202:6789/0 says I am v1:172.21.15.86:48092/0 (socket says 172.21.15.86:48092) 2023-03-06T13:49:19.851 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.837+0000 7fddb5c73700 1 -- 172.21.15.86:0/3609971923 learned_addr learned my addr 172.21.15.86:0/3609971923 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-03-06T13:49:19.851 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.837+0000 7fddb6474700 1 --2- 172.21.15.86:0/3609971923 >> v2:172.21.15.86:3300/0 conn(0x7fddb00c4f80 0x7fddb00c53a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:19.851 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.837+0000 7fddb6474700 1 -- 172.21.15.86:0/3609971923 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fddb00c29f0 msgr2=0x7fddb00c4a40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-03-06T13:49:19.851 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.837+0000 7fddb6474700 1 --2- 172.21.15.86:0/3609971923 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fddb00c29f0 0x7fddb00c4a40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:19.851 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.837+0000 7fddb6474700 1 -- 172.21.15.86:0/3609971923 >> v1:172.21.15.202:6789/0 conn(0x7fddb00c1f10 legacy=0x7fddb00c22e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:19.851 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.837+0000 7fddb6474700 1 -- 172.21.15.86:0/3609971923 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddb00c3d10 con 0x7fddb00c4f80 2023-03-06T13:49:19.852 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.836+0000 7f5af559a700 1 -- 172.21.15.86:0/2414638559 <== mon.2 v2:172.21.15.202:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5aec005e30 con 0x7f5af806ad10 2023-03-06T13:49:19.852 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.836+0000 7f5af559a700 1 -- 172.21.15.86:0/2414638559 <== mon.2 v2:172.21.15.202:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5aec006030 con 0x7f5af806ad10 2023-03-06T13:49:19.852 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.836+0000 7f5af559a700 1 -- 172.21.15.86:0/2414638559 <== mon.2 v2:172.21.15.202:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5aec0063c0 con 0x7f5af806ad10 2023-03-06T13:49:19.852 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.836+0000 7f4539c11700 1 Processor -- start 2023-03-06T13:49:19.853 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.836+0000 7f4539c11700 1 -- start start 2023-03-06T13:49:19.853 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.837+0000 7f4539c11700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f4534145510 0x7f453414f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:19.853 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.837+0000 7f4539c11700 1 --2- >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f45340bd3f0 0x7f45340bc930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:19.853 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.837+0000 7f4539c11700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45340bc4a0 con 0x7f45340b5fd0 2023-03-06T13:49:19.853 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.837+0000 7f4539c11700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45340b7e40 con 0x7f4534145510 2023-03-06T13:49:19.853 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.837+0000 7f4539c11700 1 -- --> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f453414f6d0 con 0x7f45340bd3f0 2023-03-06T13:49:19.854 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.836+0000 7fbc46d7a700 1 -- 172.21.15.86:0/2846228665 wait complete. 2023-03-06T13:49:19.854 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.837+0000 7fbc46d7a700 1 Processor -- start 2023-03-06T13:49:19.854 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.837+0000 7fbc46d7a700 1 -- start start 2023-03-06T13:49:19.855 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.837+0000 7f4533fff700 1 --2- >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f45340bd3f0 0x7f45340bc930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:19.855 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.838+0000 7f4533fff700 1 --2- >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f45340bd3f0 0x7f45340bc930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.202:3301/0 says I am v2:172.21.15.86:50588/0 (socket says 172.21.15.86:50588) 2023-03-06T13:49:19.855 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.838+0000 7f4533fff700 1 -- 172.21.15.86:0/3886085157 learned_addr learned my addr 172.21.15.86:0/3886085157 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-03-06T13:49:19.855 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.838+0000 7fddb6474700 1 --2- 172.21.15.86:0/3609971923 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fddb00c4f80 0x7fddb00c53a0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fdda8009d90 tx=0x7fdda800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0a1cc03da2dc787 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T13:49:19.855 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.838+0000 7f6023fff700 1 -- 172.21.15.86:0/3585915167 <== mon.1 v2:172.21.15.202:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f602400e070 con 0x7f602c145510 2023-03-06T13:49:19.856 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.838+0000 7f6023fff700 1 -- 172.21.15.86:0/3585915167 <== mon.1 v2:172.21.15.202:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6024003a20 con 0x7f602c145510 2023-03-06T13:49:19.856 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.838+0000 7f6023fff700 1 -- 172.21.15.86:0/3585915167 <== mon.1 v2:172.21.15.202:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6024003db0 con 0x7f602c145510 2023-03-06T13:49:19.856 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.838+0000 7f529a776700 1 -- 172.21.15.86:0/3835097119 shutdown_connections 2023-03-06T13:49:19.856 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.838+0000 7f45337fe700 1 --2- 172.21.15.86:0/3886085157 >> v2:172.21.15.86:3300/0 conn(0x7f4534145510 0x7f453414f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:19.857 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.838+0000 7f4533fff700 1 -- 172.21.15.86:0/3886085157 >> v2:172.21.15.86:3300/0 conn(0x7f4534145510 msgr2=0x7f453414f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T13:49:19.857 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.838+0000 7f4533fff700 1 --2- 172.21.15.86:0/3886085157 >> v2:172.21.15.86:3300/0 conn(0x7f4534145510 0x7f453414f0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:19.857 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.838+0000 7f4533fff700 1 -- 172.21.15.86:0/3886085157 >> v1:172.21.15.86:6789/0 conn(0x7f45340b5fd0 legacy=0x7f453406c8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T13:49:19.857 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.838+0000 7f4533fff700 1 -- 172.21.15.86:0/3886085157 --> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45341458e0 con 0x7f45340bd3f0 2023-03-06T13:49:19.857 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.837+0000 7f5afc9f2700 1 -- 172.21.15.86:0/2414638559 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f5af806ad10 msgr2=0x7f5af81575a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:19.858 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.837+0000 7f5afc9f2700 1 --2- 172.21.15.86:0/2414638559 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f5af806ad10 0x7f5af81575a0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f5aec0098f0 tx=0x7f5aec009c00 comp rx=0 tx=0).stop 2023-03-06T13:49:19.858 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.838+0000 7f529a776700 1 -- 172.21.15.86:0/3835097119 wait complete. 2023-03-06T13:49:19.858 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.838+0000 7fddb4c71700 1 -- 172.21.15.86:0/3609971923 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdda8003c20 con 0x7fddb00c4f80 2023-03-06T13:49:19.858 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.838+0000 7fddb4c71700 1 -- 172.21.15.86:0/3609971923 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdda801f070 con 0x7fddb00c4f80 2023-03-06T13:49:19.859 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.838+0000 7fddb4c71700 1 -- 172.21.15.86:0/3609971923 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdda800b8c0 con 0x7fddb00c4f80 2023-03-06T13:49:19.859 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.839+0000 7f6033a05700 1 -- 172.21.15.86:0/3585915167 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f602c145510 msgr2=0x7f602c14f0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:19.859 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.839+0000 7f6033a05700 1 --2- 172.21.15.86:0/3585915167 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f602c145510 0x7f602c14f0f0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f602c06c2b0 tx=0x7f602400b330 comp rx=0 tx=0).stop 2023-03-06T13:49:19.859 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.839+0000 7fbc46d7a700 1 --2- >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7fbc4006aa40 0x7fbc401410b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:19.860 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.839+0000 7fbc46d7a700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbc400bd940 0x7fbc4013e720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:19.860 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.839+0000 7fbc46d7a700 1 --2- >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fbc401543d0 0x7fbc4013b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:19.860 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.839+0000 7fbc46d7a700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc4013c640 con 0x7fbc400bd940 2023-03-06T13:49:19.860 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.839+0000 7fbc46d7a700 1 -- --> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc40138f90 con 0x7fbc4006aa40 2023-03-06T13:49:19.860 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.839+0000 7fbc46d7a700 1 -- --> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc4013f2c0 con 0x7fbc401543d0 2023-03-06T13:49:19.861 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.839+0000 7f6033a05700 1 -- 172.21.15.86:0/3585915167 shutdown_connections 2023-03-06T13:49:19.862 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.839+0000 7f6033a05700 1 --2- 172.21.15.86:0/3585915167 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f602c145510 0x7f602c14f0f0 secure :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f602c06c2b0 tx=0x7f602400b330 comp rx=0 tx=0).stop 2023-03-06T13:49:19.862 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.839+0000 7f6033a05700 1 --2- 172.21.15.86:0/3585915167 >> v2:172.21.15.86:3300/0 conn(0x7f602c0b5fd0 0x7f602c0bc930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:19.862 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.839+0000 7f6033a05700 1 -- 172.21.15.86:0/3585915167 >> 172.21.15.86:0/3585915167 conn(0x7f602c06afc0 msgr2=0x7f602c0c1050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T13:49:19.862 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.839+0000 7fedb0283700 1 Processor -- start 2023-03-06T13:49:19.862 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.839+0000 7fedb0283700 1 -- start start 2023-03-06T13:49:19.863 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.839+0000 7f5afc9f2700 1 -- 172.21.15.86:0/2414638559 shutdown_connections 2023-03-06T13:49:19.863 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.839+0000 7f5afc9f2700 1 --2- 172.21.15.86:0/2414638559 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f5af806ad10 0x7f5af81575a0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:19.863 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.839+0000 7f5afc9f2700 1 -- 172.21.15.86:0/2414638559 >> 172.21.15.86:0/2414638559 conn(0x7f5af80a4180 msgr2=0x7f5af80c18f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T13:49:19.863 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.839+0000 7f5afc9f2700 1 -- 172.21.15.86:0/2414638559 shutdown_connections 2023-03-06T13:49:19.864 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.839+0000 7f4533fff700 1 --2- 172.21.15.86:0/3886085157 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f45340bd3f0 0x7f45340bc930 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f452c00d370 tx=0x7f452c00d680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4ed9ed04cf4969ed server_cookie=0 in_seq=0 out_seq=0 2023-03-06T13:49:19.864 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.840+0000 7f529a776700 1 Processor -- start 2023-03-06T13:49:19.864 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.840+0000 7f529a776700 1 -- start start 2023-03-06T13:49:19.865 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.840+0000 7fddb7ed7700 1 -- 172.21.15.86:0/3609971923 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fddb00c4f80 msgr2=0x7fddb00c53a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:19.865 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.840+0000 7fddb7ed7700 1 --2- 172.21.15.86:0/3609971923 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fddb00c4f80 0x7fddb00c53a0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fdda8009d90 tx=0x7fdda800b330 comp rx=0 tx=0).stop 2023-03-06T13:49:19.866 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.839+0000 7f5afc9f2700 1 -- 172.21.15.86:0/2414638559 wait complete. 2023-03-06T13:49:19.866 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.840+0000 7f6033a05700 1 -- 172.21.15.86:0/3585915167 shutdown_connections 2023-03-06T13:49:19.867 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.840+0000 7f45327fc700 1 -- 172.21.15.86:0/3886085157 <== mon.2 v2:172.21.15.202:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f452c010070 con 0x7f45340bd3f0 2023-03-06T13:49:19.867 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.840+0000 7f45327fc700 1 -- 172.21.15.86:0/3886085157 <== mon.2 v2:172.21.15.202:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f452c00dcd0 con 0x7f45340bd3f0 2023-03-06T13:49:19.868 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.840+0000 7f45327fc700 1 -- 172.21.15.86:0/3886085157 <== mon.2 v2:172.21.15.202:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f452c007d50 con 0x7f45340bd3f0 2023-03-06T13:49:19.868 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.841+0000 7f4539c11700 1 -- 172.21.15.86:0/3886085157 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f45340bd3f0 msgr2=0x7f45340bc930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:19.868 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.841+0000 7f4539c11700 1 --2- 172.21.15.86:0/3886085157 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f45340bd3f0 0x7f45340bc930 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f452c00d370 tx=0x7f452c00d680 comp rx=0 tx=0).stop 2023-03-06T13:49:19.868 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.841+0000 7f4539c11700 1 -- 172.21.15.86:0/3886085157 shutdown_connections 2023-03-06T13:49:19.869 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.841+0000 7f4539c11700 1 --2- 172.21.15.86:0/3886085157 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f45340bd3f0 0x7f45340bc930 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:19.869 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.841+0000 7f4539c11700 1 --2- 172.21.15.86:0/3886085157 >> v2:172.21.15.86:3300/0 conn(0x7f4534145510 0x7f453414f0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:19.869 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.841+0000 7f4539c11700 1 -- 172.21.15.86:0/3886085157 >> 172.21.15.86:0/3886085157 conn(0x7f453406afc0 msgr2=0x7f45340c1050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T13:49:19.870 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.839+0000 7fbc3ffff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbc400bd940 0x7fbc4013e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:19.870 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.839+0000 7fbc3ffff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbc400bd940 0x7fbc4013e720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:38900/0 (socket says 172.21.15.86:38900) 2023-03-06T13:49:19.870 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.839+0000 7fbc3ffff700 1 -- 172.21.15.86:0/4180836382 learned_addr learned my addr 172.21.15.86:0/4180836382 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-03-06T13:49:19.870 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.839+0000 7fbc44b16700 1 --2- 172.21.15.86:0/4180836382 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7fbc4006aa40 0x7fbc401410b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:19.871 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.840+0000 7fbc45317700 1 --2- 172.21.15.86:0/4180836382 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fbc401543d0 0x7fbc4013b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:19.871 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.840+0000 7fbc3ffff700 1 -- 172.21.15.86:0/4180836382 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fbc401543d0 msgr2=0x7fbc4013b8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:19.871 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.840+0000 7fbc3ffff700 1 --2- 172.21.15.86:0/4180836382 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fbc401543d0 0x7fbc4013b8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:19.872 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.840+0000 7fbc3ffff700 1 -- 172.21.15.86:0/4180836382 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7fbc4006aa40 msgr2=0x7fbc401410b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:19.872 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.840+0000 7fbc3ffff700 1 --2- 172.21.15.86:0/4180836382 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7fbc4006aa40 0x7fbc401410b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:19.872 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.840+0000 7fbc3ffff700 1 -- 172.21.15.86:0/4180836382 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc38009b30 con 0x7fbc400bd940 2023-03-06T13:49:19.872 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.840+0000 7fbc3ffff700 1 --2- 172.21.15.86:0/4180836382 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbc400bd940 0x7fbc4013e720 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fbc3400c4a0 tx=0x7fbc3400c7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T13:49:19.873 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.840+0000 7fedb0283700 1 --2- >> v2:172.21.15.202:3300/0 conn(0x7feda80bd6e0 0x7feda80baa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:19.873 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.840+0000 7fedb0283700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feda80bd250 con 0x7feda80c19d0 2023-03-06T13:49:19.873 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.840+0000 7fedb0283700 1 -- --> v1:172.21.15.202:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feda81542d0 con 0x7feda80a6e80 2023-03-06T13:49:19.873 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.840+0000 7fedb0283700 1 -- --> v2:172.21.15.202:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feda80b6360 con 0x7feda80bd6e0 2023-03-06T13:49:19.873 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.840+0000 7fedae01f700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7feda80c19d0 0x7feda806c8a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:49054/0 (socket says 172.21.15.86:49054) 2023-03-06T13:49:19.874 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.840+0000 7fedae01f700 1 -- 172.21.15.86:0/604358549 learned_addr learned my addr 172.21.15.86:0/604358549 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-03-06T13:49:19.874 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.841+0000 7fedad81e700 1 --2- 172.21.15.86:0/604358549 >> v2:172.21.15.202:3300/0 conn(0x7feda80bd6e0 0x7feda80baa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:19.874 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.841+0000 7f5afc9f2700 1 Processor -- start 2023-03-06T13:49:19.874 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.841+0000 7f5afc9f2700 1 -- start start 2023-03-06T13:49:19.875 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.841+0000 7f529a776700 1 --2- >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f52940bd940 0x7f529414e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:19.875 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.841+0000 7f529a776700 1 --2- >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f52940bf580 0x7f52941e9ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:19.875 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.841+0000 7f529a776700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f52941543d0 0x7f52941466f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:19.875 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.841+0000 7f529a776700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52941e9a10 con 0x7f52941543d0 2023-03-06T13:49:19.875 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.841+0000 7f529a776700 1 -- --> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f529414b5d0 con 0x7f52940bd940 2023-03-06T13:49:19.876 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.841+0000 7f529a776700 1 -- --> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52941e96e0 con 0x7f52940bf580 2023-03-06T13:49:19.876 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.841+0000 7fedad81e700 1 -- 172.21.15.86:0/604358549 >> v1:172.21.15.202:6789/0 conn(0x7feda80a6e80 legacy=0x7feda815de10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:19.876 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.841+0000 7fedad81e700 1 -- 172.21.15.86:0/604358549 >> v1:172.21.15.86:6789/0 conn(0x7feda80c19d0 legacy=0x7feda806c8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:19.877 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.841+0000 7fedad01d700 1 -- 172.21.15.86:0/604358549 <== mon.1 v1:172.21.15.202:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 489213617 0 0) 0x7feda81542d0 con 0x7feda80a6e80 2023-03-06T13:49:19.877 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.841+0000 7fedad81e700 1 -- 172.21.15.86:0/604358549 --> v2:172.21.15.202:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feda80b6640 con 0x7feda80bd6e0 2023-03-06T13:49:19.877 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.842+0000 7f5293fff700 1 --2- >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f52940bd940 0x7f529414e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:19.878 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.842+0000 7f52937fe700 1 --2- >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f52940bf580 0x7f52941e9ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:19.878 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.842+0000 7f5293fff700 1 --2- >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f52940bd940 0x7f529414e1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.202:3300/0 says I am v2:172.21.15.86:44442/0 (socket says 172.21.15.86:44442) 2023-03-06T13:49:19.878 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.842+0000 7f52937fe700 1 --2- >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f52940bf580 0x7f52941e9ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.202:3301/0 says I am v2:172.21.15.86:50604/0 (socket says 172.21.15.86:50604) 2023-03-06T13:49:19.878 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.842+0000 7f5293fff700 1 -- 172.21.15.86:0/2081613494 learned_addr learned my addr 172.21.15.86:0/2081613494 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-03-06T13:49:19.878 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.842+0000 7fddb7ed7700 1 -- 172.21.15.86:0/3609971923 shutdown_connections 2023-03-06T13:49:19.879 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.842+0000 7fddb7ed7700 1 --2- 172.21.15.86:0/3609971923 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fddb00c4f80 0x7fddb00c53a0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:19.879 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.842+0000 7fddb7ed7700 1 --2- 172.21.15.86:0/3609971923 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fddb00c29f0 0x7fddb00c4a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:19.879 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.842+0000 7fddb7ed7700 1 -- 172.21.15.86:0/3609971923 >> 172.21.15.86:0/3609971923 conn(0x7fddb006b750 msgr2=0x7fddb006bb50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T13:49:19.880 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.842+0000 7fbc3d7fa700 1 -- 172.21.15.86:0/4180836382 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc340054e0 con 0x7fbc400bd940 2023-03-06T13:49:19.880 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.842+0000 7fbc3d7fa700 1 -- 172.21.15.86:0/4180836382 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc34003680 con 0x7fbc400bd940 2023-03-06T13:49:19.880 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.842+0000 7fbc3d7fa700 1 -- 172.21.15.86:0/4180836382 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc34003a30 con 0x7fbc400bd940 2023-03-06T13:49:19.880 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.842+0000 7fddb7ed7700 1 -- 172.21.15.86:0/3609971923 shutdown_connections 2023-03-06T13:49:19.881 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.842+0000 7f4539c11700 1 -- 172.21.15.86:0/3886085157 shutdown_connections 2023-03-06T13:49:19.881 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.840+0000 7f6033a05700 1 -- 172.21.15.86:0/3585915167 wait complete. 2023-03-06T13:49:19.881 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.842+0000 7f6033a05700 1 Processor -- start 2023-03-06T13:49:19.882 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.842+0000 7f52937fe700 1 -- 172.21.15.86:0/2081613494 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f52940bd940 msgr2=0x7f529414e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:19.882 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.842+0000 7f52937fe700 1 --2- 172.21.15.86:0/2081613494 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f52940bd940 0x7f529414e1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:19.882 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.842+0000 7f52937fe700 1 -- 172.21.15.86:0/2081613494 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f52941543d0 msgr2=0x7f52941466f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-03-06T13:49:19.883 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.842+0000 7f52937fe700 1 --2- 172.21.15.86:0/2081613494 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f52941543d0 0x7f52941466f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:19.883 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.842+0000 7f52937fe700 1 -- 172.21.15.86:0/2081613494 --> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f527c009550 con 0x7f52940bf580 2023-03-06T13:49:19.883 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.842+0000 7f5afc9f2700 1 --2- >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f5af806ad10 0x7f5af80a5c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:19.883 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.842+0000 7f5afc9f2700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5af80c2270 0x7f5af80bb080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:19.883 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.842+0000 7f5afc9f2700 1 --2- >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f5af8157ae0 0x7f5af80b7ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:19.883 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.842+0000 7f5afc9f2700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5af80baa30 con 0x7f5af80c2270 2023-03-06T13:49:19.884 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.842+0000 7f5afc9f2700 1 -- --> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5af80a6560 con 0x7f5af8157ae0 2023-03-06T13:49:19.884 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.842+0000 7f5afc9f2700 1 -- --> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5af8070630 con 0x7f5af806ad10 2023-03-06T13:49:19.884 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.842+0000 7f52937fe700 1 --2- 172.21.15.86:0/2081613494 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f52940bf580 0x7f52941e9ea0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f528c007e60 tx=0x7f528c00e3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T13:49:19.884 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.843+0000 7f5290ff9700 1 -- 172.21.15.86:0/2081613494 <== mon.2 v2:172.21.15.202:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f528c00ede0 con 0x7f52940bf580 2023-03-06T13:49:19.885 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.843+0000 7f5290ff9700 1 -- 172.21.15.86:0/2081613494 <== mon.2 v2:172.21.15.202:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f528c014420 con 0x7f52940bf580 2023-03-06T13:49:19.885 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.843+0000 7f5290ff9700 1 -- 172.21.15.86:0/2081613494 <== mon.2 v2:172.21.15.202:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f528c0147d0 con 0x7f52940bf580 2023-03-06T13:49:19.885 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.843+0000 7f529a776700 1 -- 172.21.15.86:0/2081613494 --> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f529406edf0 con 0x7f52940bf580 2023-03-06T13:49:19.885 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.843+0000 7f529a776700 1 -- 172.21.15.86:0/2081613494 --> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f529406dda0 con 0x7f52940bf580 2023-03-06T13:49:19.885 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.843+0000 7f5af5d9b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5af80c2270 0x7f5af80bb080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:19.886 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.843+0000 7f5af5d9b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5af80c2270 0x7f5af80bb080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:38916/0 (socket says 172.21.15.86:38916) 2023-03-06T13:49:19.886 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.843+0000 7f5af5d9b700 1 -- 172.21.15.86:0/2294604524 learned_addr learned my addr 172.21.15.86:0/2294604524 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-03-06T13:49:19.886 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.842+0000 7f6033a05700 1 -- start start 2023-03-06T13:49:19.887 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.843+0000 7f6033a05700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f602c0b5fd0 0x7f602c06f730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:19.887 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.843+0000 7f6033a05700 1 --2- >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f602c0bd3f0 0x7f602c0707e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:19.887 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.843+0000 7f6033a05700 1 --2- >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f602c0bf1a0 0x7f602c0bf610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:19.887 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.843+0000 7f6033a05700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f602c06fc70 con 0x7f602c0b5fd0 2023-03-06T13:49:19.887 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.843+0000 7f6033a05700 1 -- --> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f602c0bfb50 con 0x7f602c0bf1a0 2023-03-06T13:49:19.887 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.843+0000 7f6033a05700 1 -- --> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f602c0728a0 con 0x7f602c0bd3f0 2023-03-06T13:49:19.888 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.842+0000 7fddb7ed7700 1 -- 172.21.15.86:0/3609971923 wait complete. 2023-03-06T13:49:19.888 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.844+0000 7fddb7ed7700 1 Processor -- start 2023-03-06T13:49:19.889 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.843+0000 7f5af5d9b700 1 -- 172.21.15.86:0/2294604524 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f5af806ad10 msgr2=0x7f5af80a5c30 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-03-06T13:49:19.889 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.843+0000 7f5af5d9b700 1 --2- 172.21.15.86:0/2294604524 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f5af806ad10 0x7f5af80a5c30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:19.889 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.843+0000 7f5af5d9b700 1 -- 172.21.15.86:0/2294604524 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f5af8157ae0 msgr2=0x7f5af80b7ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:19.889 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.843+0000 7f5af5d9b700 1 --2- 172.21.15.86:0/2294604524 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f5af8157ae0 0x7f5af80b7ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:19.889 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.843+0000 7f5af5d9b700 1 -- 172.21.15.86:0/2294604524 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5aec009500 con 0x7f5af80c2270 2023-03-06T13:49:19.890 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.843+0000 7f6030fa0700 1 --2- >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f602c0bd3f0 0x7f602c0707e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:19.890 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.843+0000 7f6031fa2700 1 --2- >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f602c0bf1a0 0x7f602c0bf610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:19.891 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.843+0000 7f60317a1700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f602c0b5fd0 0x7f602c06f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:19.891 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.843+0000 7f6030fa0700 1 --2- >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f602c0bd3f0 0x7f602c0707e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.202:3301/0 says I am v2:172.21.15.86:50616/0 (socket says 172.21.15.86:50616) 2023-03-06T13:49:19.891 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.843+0000 7f6030fa0700 1 -- 172.21.15.86:0/124183645 learned_addr learned my addr 172.21.15.86:0/124183645 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-03-06T13:49:19.891 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.843+0000 7f60317a1700 1 --2- 172.21.15.86:0/124183645 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f602c0b5fd0 0x7f602c06f730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:38920/0 (socket says 172.21.15.86:38920) 2023-03-06T13:49:19.892 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.842+0000 7f4539c11700 1 -- 172.21.15.86:0/3886085157 wait complete. 2023-03-06T13:49:19.892 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.844+0000 7f4539c11700 1 Processor -- start 2023-03-06T13:49:19.892 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.844+0000 7fbc46d7a700 1 -- 172.21.15.86:0/4180836382 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc4006dda0 con 0x7fbc400bd940 2023-03-06T13:49:19.892 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.844+0000 7fbc46d7a700 1 -- 172.21.15.86:0/4180836382 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc4006e420 con 0x7fbc400bd940 2023-03-06T13:49:19.893 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.844+0000 7f5af5d9b700 1 --2- 172.21.15.86:0/2294604524 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5af80c2270 0x7f5af80bb080 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f5aec009c40 tx=0x7f5aec004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T13:49:19.893 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.845+0000 7f5290ff9700 1 -- 172.21.15.86:0/2081613494 <== mon.2 v2:172.21.15.202:3301/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f528c012050 con 0x7f52940bf580 2023-03-06T13:49:19.893 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.845+0000 7f5290ff9700 1 --2- 172.21.15.86:0/2081613494 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7f52740682f0 0x7f527406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:19.893 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.845+0000 7f5290ff9700 1 -- 172.21.15.86:0/2081613494 <== mon.2 v2:172.21.15.202:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f528c0862c0 con 0x7f52940bf580 2023-03-06T13:49:19.894 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.846+0000 7f5293fff700 1 --2- 172.21.15.86:0/2081613494 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7f52740682f0 0x7f527406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:19.894 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.846+0000 7f5293fff700 1 --2- 172.21.15.86:0/2081613494 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7f52740682f0 0x7f527406a7a0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f52940700b0 tx=0x7f5284009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T13:49:19.894 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.844+0000 7fddb7ed7700 1 -- start start 2023-03-06T13:49:19.895 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.845+0000 7fddb7ed7700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fddb00c1f10 0x7fddb00a4f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:19.895 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.845+0000 7fddb7ed7700 1 --2- >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fddb00c29f0 0x7fddb01dccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:19.895 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.845+0000 7fddb7ed7700 1 --2- >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7fddb00c4f80 0x7fddb01dd230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:19.895 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.845+0000 7fddb7ed7700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddb00a60d0 con 0x7fddb00c1f10 2023-03-06T13:49:19.895 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.845+0000 7fddb7ed7700 1 -- --> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddb00a5460 con 0x7fddb00c4f80 2023-03-06T13:49:19.895 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.845+0000 7fddb7ed7700 1 -- --> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddb00a5b10 con 0x7fddb00c29f0 2023-03-06T13:49:19.896 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.844+0000 7f5ae6ffd700 1 -- 172.21.15.86:0/2294604524 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5aec004040 con 0x7f5af80c2270 2023-03-06T13:49:19.896 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.844+0000 7f5ae6ffd700 1 -- 172.21.15.86:0/2294604524 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5aec020070 con 0x7f5af80c2270 2023-03-06T13:49:19.896 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.844+0000 7f5ae6ffd700 1 -- 172.21.15.86:0/2294604524 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5aec004420 con 0x7f5af80c2270 2023-03-06T13:49:19.896 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.844+0000 7f5afc9f2700 1 -- 172.21.15.86:0/2294604524 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5af80c03e0 con 0x7f5af80c2270 2023-03-06T13:49:19.896 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.844+0000 7f5afc9f2700 1 -- 172.21.15.86:0/2294604524 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5af80c0100 con 0x7f5af80c2270 2023-03-06T13:49:19.897 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.844+0000 7f6031fa2700 1 -- 172.21.15.86:0/124183645 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f602c0bd3f0 msgr2=0x7f602c0707e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:19.897 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.844+0000 7f6031fa2700 1 --2- 172.21.15.86:0/124183645 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f602c0bd3f0 0x7f602c0707e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:19.897 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.844+0000 7f6031fa2700 1 -- 172.21.15.86:0/124183645 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f602c0b5fd0 msgr2=0x7f602c06f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:19.898 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.844+0000 7f6031fa2700 1 --2- 172.21.15.86:0/124183645 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f602c0b5fd0 0x7f602c06f730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:19.898 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.844+0000 7f6031fa2700 1 -- 172.21.15.86:0/124183645 --> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6024009b30 con 0x7f602c0bf1a0 2023-03-06T13:49:19.898 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.844+0000 7f4539c11700 1 -- start start 2023-03-06T13:49:19.899 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.845+0000 7f4539c11700 1 --2- >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f45340b5fd0 0x7f45340bf690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:19.899 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.845+0000 7f4539c11700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f45340bd3f0 0x7f453413ed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:19.899 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.845+0000 7f4539c11700 1 --2- >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f4534145510 0x7f453413f270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:19.899 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.845+0000 7f4539c11700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f453413c1b0 con 0x7f45340bd3f0 2023-03-06T13:49:19.899 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.845+0000 7f4539c11700 1 -- --> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f453413e8a0 con 0x7f4534145510 2023-03-06T13:49:19.900 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.845+0000 7f4539c11700 1 -- --> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45340bfbd0 con 0x7f45340b5fd0 2023-03-06T13:49:19.900 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.846+0000 7f6031fa2700 1 --2- 172.21.15.86:0/124183645 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f602c0bf1a0 0x7f602c0bf610 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f601c00c360 tx=0x7f601c00c670 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T13:49:19.901 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.846+0000 7fddb6474700 1 --2- >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7fddb00c4f80 0x7fddb01dd230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:19.901 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.846+0000 7fddb6474700 1 --2- >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7fddb00c4f80 0x7fddb01dd230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.202:3300/0 says I am v2:172.21.15.86:44468/0 (socket says 172.21.15.86:44468) 2023-03-06T13:49:19.902 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.846+0000 7fddb6474700 1 -- 172.21.15.86:0/3611595354 learned_addr learned my addr 172.21.15.86:0/3611595354 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-03-06T13:49:19.902 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.846+0000 7fbc3d7fa700 1 -- 172.21.15.86:0/4180836382 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fbc34019030 con 0x7fbc400bd940 2023-03-06T13:49:19.902 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.846+0000 7fddb5472700 1 --2- 172.21.15.86:0/3611595354 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fddb00c29f0 0x7fddb01dccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:19.903 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.846+0000 7f6021ffb700 1 -- 172.21.15.86:0/124183645 <== mon.1 v2:172.21.15.202:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f601c0052d0 con 0x7f602c0bf1a0 2023-03-06T13:49:19.903 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.846+0000 7f6021ffb700 1 -- 172.21.15.86:0/124183645 <== mon.1 v2:172.21.15.202:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f601c005430 con 0x7f602c0bf1a0 2023-03-06T13:49:19.903 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.846+0000 7f6021ffb700 1 -- 172.21.15.86:0/124183645 <== mon.1 v2:172.21.15.202:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f601c0038a0 con 0x7f602c0bf1a0 2023-03-06T13:49:19.903 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.846+0000 7f5afc9f2700 1 -- 172.21.15.86:0/2294604524 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ad8005310 con 0x7f5af80c2270 2023-03-06T13:49:19.904 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.847+0000 7fbc3d7fa700 1 --2- 172.21.15.86:0/4180836382 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7fbc2c068340 0x7fbc2c06a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:19.904 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.847+0000 7f45337fe700 1 --2- >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f45340b5fd0 0x7f45340bf690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:19.905 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.847+0000 7f45337fe700 1 --2- >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f45340b5fd0 0x7f45340bf690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.202:3301/0 says I am v2:172.21.15.86:50620/0 (socket says 172.21.15.86:50620) 2023-03-06T13:49:19.905 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.847+0000 7f45337fe700 1 -- 172.21.15.86:0/2287193389 learned_addr learned my addr 172.21.15.86:0/2287193389 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-03-06T13:49:19.905 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.847+0000 7fddb6474700 1 -- 172.21.15.86:0/3611595354 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fddb00c29f0 msgr2=0x7fddb01dccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:19.905 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.847+0000 7fddb6474700 1 --2- 172.21.15.86:0/3611595354 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fddb00c29f0 0x7fddb01dccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:19.906 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.847+0000 7fddb6474700 1 -- 172.21.15.86:0/3611595354 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fddb00c1f10 msgr2=0x7fddb00a4f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:19.906 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.847+0000 7fddb6474700 1 --2- 172.21.15.86:0/3611595354 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fddb00c1f10 0x7fddb00a4f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:19.906 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.847+0000 7fddb6474700 1 -- 172.21.15.86:0/3611595354 --> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdda8009a70 con 0x7fddb00c4f80 2023-03-06T13:49:19.906 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.846+0000 7fedad81e700 1 --2- 172.21.15.86:0/604358549 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7feda80bd6e0 0x7feda80baa20 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fed98009840 tx=0x7fed98009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fe8f4d6c6a0ebe1d server_cookie=0 in_seq=0 out_seq=0 2023-03-06T13:49:19.907 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.847+0000 7fbc3d7fa700 1 -- 172.21.15.86:0/4180836382 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fbc34084fb0 con 0x7fbc400bd940 2023-03-06T13:49:19.907 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.847+0000 7fedad01d700 1 -- 172.21.15.86:0/604358549 <== mon.1 v2:172.21.15.202:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed98011830 con 0x7feda80bd6e0 2023-03-06T13:49:19.907 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.847+0000 7fedad01d700 1 -- 172.21.15.86:0/604358549 <== mon.1 v2:172.21.15.202:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed98011990 con 0x7feda80bd6e0 2023-03-06T13:49:19.908 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.847+0000 7fedad01d700 1 -- 172.21.15.86:0/604358549 <== mon.1 v2:172.21.15.202:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed98011d20 con 0x7feda80bd6e0 2023-03-06T13:49:19.908 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.847+0000 7f4532ffd700 1 --2- 172.21.15.86:0/2287193389 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f45340bd3f0 0x7f453413ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:19.909 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.847+0000 7fddb6474700 1 --2- 172.21.15.86:0/3611595354 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7fddb00c4f80 0x7fddb01dd230 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fdda800b730 tx=0x7fdda8004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T13:49:19.909 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.847+0000 7fdda67fc700 1 -- 172.21.15.86:0/3611595354 <== mon.1 v2:172.21.15.202:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdda80044c0 con 0x7fddb00c4f80 2023-03-06T13:49:19.909 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.847+0000 7fdda67fc700 1 -- 172.21.15.86:0/3611595354 <== mon.1 v2:172.21.15.202:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdda8004620 con 0x7fddb00c4f80 2023-03-06T13:49:19.909 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.847+0000 7fdda67fc700 1 -- 172.21.15.86:0/3611595354 <== mon.1 v2:172.21.15.202:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdda8023440 con 0x7fddb00c4f80 2023-03-06T13:49:19.910 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.847+0000 7f5ae6ffd700 1 -- 172.21.15.86:0/2294604524 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f5aec02b020 con 0x7f5af80c2270 2023-03-06T13:49:19.910 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.847+0000 7f5ae6ffd700 1 --2- 172.21.15.86:0/2294604524 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7f5ae00687b0 0x7f5ae006ac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:19.910 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.847+0000 7f5ae6ffd700 1 -- 172.21.15.86:0/2294604524 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5aec087470 con 0x7f5af80c2270 2023-03-06T13:49:19.911 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.847+0000 7f4533fff700 1 --2- 172.21.15.86:0/2287193389 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f4534145510 0x7f453413f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:19.911 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.848+0000 7f4532ffd700 1 -- 172.21.15.86:0/2287193389 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f45340b5fd0 msgr2=0x7f45340bf690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:19.911 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.848+0000 7f4532ffd700 1 --2- 172.21.15.86:0/2287193389 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f45340b5fd0 0x7f45340bf690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:19.911 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.848+0000 7f4532ffd700 1 -- 172.21.15.86:0/2287193389 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f4534145510 msgr2=0x7f453413f270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:19.912 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.848+0000 7f4532ffd700 1 --2- 172.21.15.86:0/2287193389 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f4534145510 0x7f453413f270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:19.912 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.848+0000 7f4532ffd700 1 -- 172.21.15.86:0/2287193389 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f452c00d050 con 0x7f45340bd3f0 2023-03-06T13:49:19.912 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.848+0000 7fedb0283700 1 -- 172.21.15.86:0/604358549 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7feda80bd6e0 msgr2=0x7feda80baa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:19.912 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.848+0000 7fedb0283700 1 --2- 172.21.15.86:0/604358549 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7feda80bd6e0 0x7feda80baa20 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fed98009840 tx=0x7fed98009b50 comp rx=0 tx=0).stop 2023-03-06T13:49:19.913 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.848+0000 7f5af659c700 1 --2- 172.21.15.86:0/2294604524 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7f5ae00687b0 0x7f5ae006ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:19.913 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.848+0000 7f529a776700 1 -- 172.21.15.86:0/2081613494 --> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f529406ea50 con 0x7f52940bf580 2023-03-06T13:49:19.913 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.847+0000 7fbc44b16700 1 --2- 172.21.15.86:0/4180836382 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7fbc2c068340 0x7fbc2c06a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:19.914 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.848+0000 7fedb0283700 1 -- 172.21.15.86:0/604358549 shutdown_connections 2023-03-06T13:49:19.914 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.848+0000 7fedb0283700 1 --2- 172.21.15.86:0/604358549 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7feda80bd6e0 0x7feda80baa20 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:19.914 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.848+0000 7fedb0283700 1 -- 172.21.15.86:0/604358549 >> 172.21.15.86:0/604358549 conn(0x7feda806afc0 msgr2=0x7feda80c1050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T13:49:19.916 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.848+0000 7f4532ffd700 1 --2- 172.21.15.86:0/2287193389 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f45340bd3f0 0x7f453413ed30 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f452400b420 tx=0x7f452400b7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T13:49:19.916 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.848+0000 7fedb0283700 1 -- 172.21.15.86:0/604358549 shutdown_connections 2023-03-06T13:49:19.917 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.848+0000 7fedb0283700 1 -- 172.21.15.86:0/604358549 wait complete. 2023-03-06T13:49:19.917 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.848+0000 7f5af659c700 1 --2- 172.21.15.86:0/2294604524 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7f5ae00687b0 0x7f5ae006ac60 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f5ae8007fd0 tx=0x7f5ae8007940 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T13:49:19.917 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.848+0000 7fddb7ed7700 1 -- 172.21.15.86:0/3611595354 --> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddb00c3760 con 0x7fddb00c4f80 2023-03-06T13:49:19.918 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.848+0000 7fddb7ed7700 1 -- 172.21.15.86:0/3611595354 --> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddb00bf6e0 con 0x7fddb00c4f80 2023-03-06T13:49:19.918 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.849+0000 7fbc44b16700 1 --2- 172.21.15.86:0/4180836382 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7fbc2c068340 0x7fbc2c06a7f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fbc38015040 tx=0x7fbc38009000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T13:49:19.918 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.847+0000 7f6033a05700 1 -- 172.21.15.86:0/124183645 --> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f602c0bbe50 con 0x7f602c0bf1a0 2023-03-06T13:49:19.919 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.848+0000 7f6033a05700 1 -- 172.21.15.86:0/124183645 --> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f602c0bbb70 con 0x7f602c0bf1a0 2023-03-06T13:49:19.919 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.849+0000 7f6033a05700 1 -- 172.21.15.86:0/124183645 --> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f602c0bc130 con 0x7f602c0bf1a0 2023-03-06T13:49:19.919 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.849+0000 7fbc46d7a700 1 -- 172.21.15.86:0/4180836382 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc401415f0 con 0x7fbc400bd940 2023-03-06T13:49:19.920 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.850+0000 7fedb0283700 1 Processor -- start 2023-03-06T13:49:19.920 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.850+0000 7fedb0283700 1 -- start start 2023-03-06T13:49:19.921 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.850+0000 7fddb7ed7700 1 -- 172.21.15.86:0/3611595354 --> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fddb00c3270 con 0x7fddb00c4f80 2023-03-06T13:49:19.921 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.851+0000 7fdda67fc700 1 -- 172.21.15.86:0/3611595354 <== mon.1 v2:172.21.15.202:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fdda803e070 con 0x7fddb00c4f80 2023-03-06T13:49:19.921 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.851+0000 7f6021ffb700 1 -- 172.21.15.86:0/124183645 <== mon.1 v2:172.21.15.202:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f601c010070 con 0x7f602c0bf1a0 2023-03-06T13:49:19.922 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.851+0000 7fedb0283700 1 --2- >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7feda80a6e80 0x7feda81ec1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:19.923 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.851+0000 7fedb0283700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feda80bd6e0 0x7feda814f800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:19.923 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.851+0000 7fedb0283700 1 --2- >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7feda80c19d0 0x7feda81508a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:19.923 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.851+0000 7fedb0283700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feda8071020 con 0x7feda80bd6e0 2023-03-06T13:49:19.923 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.851+0000 7fedb0283700 1 -- --> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feda8071300 con 0x7feda80c19d0 2023-03-06T13:49:19.924 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.851+0000 7fedb0283700 1 -- --> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feda80715e0 con 0x7feda80a6e80 2023-03-06T13:49:19.924 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.851+0000 7f6021ffb700 1 --2- 172.21.15.86:0/124183645 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7f60100682f0 0x7f601006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:19.925 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.851+0000 7f6021ffb700 1 -- 172.21.15.86:0/124183645 <== mon.1 v2:172.21.15.202:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f601c084b10 con 0x7f602c0bf1a0 2023-03-06T13:49:19.925 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.851+0000 7f6c2fd33700 1 Processor -- start 2023-03-06T13:49:19.926 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.851+0000 7fedae820700 1 --2- >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7feda80c19d0 0x7feda81508a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:19.926 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.851+0000 7fdda67fc700 1 --2- 172.21.15.86:0/3611595354 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7fdd94068340 0x7fdd9406a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:19.927 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.851+0000 7fedae820700 1 --2- >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7feda80c19d0 0x7feda81508a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.202:3300/0 says I am v2:172.21.15.86:44474/0 (socket says 172.21.15.86:44474) 2023-03-06T13:49:19.927 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.851+0000 7fedae820700 1 -- 172.21.15.86:0/3398209389 learned_addr learned my addr 172.21.15.86:0/3398209389 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-03-06T13:49:19.928 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.852+0000 7f60317a1700 1 --2- 172.21.15.86:0/124183645 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7f60100682f0 0x7f601006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:19.928 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.852+0000 7fedad81e700 1 --2- 172.21.15.86:0/3398209389 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feda80bd6e0 0x7feda814f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:19.929 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.852+0000 7fddb5c73700 1 --2- 172.21.15.86:0/3611595354 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7fdd94068340 0x7fdd9406a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:19.930 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.852+0000 7fedae01f700 1 --2- 172.21.15.86:0/3398209389 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7feda80a6e80 0x7feda81ec1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:19.930 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.852+0000 7fedae820700 1 -- 172.21.15.86:0/3398209389 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7feda80a6e80 msgr2=0x7feda81ec1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:19.931 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.852+0000 7fedae820700 1 --2- 172.21.15.86:0/3398209389 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7feda80a6e80 0x7feda81ec1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:19.931 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.852+0000 7fedae820700 1 -- 172.21.15.86:0/3398209389 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feda80bd6e0 msgr2=0x7feda814f800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:19.931 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.852+0000 7fedae820700 1 --2- 172.21.15.86:0/3398209389 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feda80bd6e0 0x7feda814f800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:19.932 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.852+0000 7fedae820700 1 -- 172.21.15.86:0/3398209389 --> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed980094a0 con 0x7feda80c19d0 2023-03-06T13:49:19.932 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.852+0000 7fedae820700 1 --2- 172.21.15.86:0/3398209389 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7feda80c19d0 0x7feda81508a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7feda0001560 tx=0x7feda000cc00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T13:49:19.933 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.852+0000 7f60317a1700 1 --2- 172.21.15.86:0/124183645 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7f60100682f0 0x7f601006a7a0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f602c06d780 tx=0x7f6024009000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T13:49:19.933 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.852+0000 7fddb5c73700 1 --2- 172.21.15.86:0/3611595354 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7fdd94068340 0x7fdd9406a7f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fdda0000f60 tx=0x7fdda0007a70 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T13:49:19.934 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.852+0000 7f6c2fd33700 1 -- start start 2023-03-06T13:49:19.935 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.853+0000 7f6c2fd33700 1 --2- >> v2:172.21.15.202:3300/0 conn(0x7f6c2806ad10 0x7f6c281575a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:19.935 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.853+0000 7f6c2fd33700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f6c28157ae0 0x7f6c2815e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:19.935 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.853+0000 7f6c2fd33700 1 -- --> v1:172.21.15.202:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c280bf6f0 con 0x7f6c280c2270 2023-03-06T13:49:19.935 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.853+0000 7f6c2fd33700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c2806baf0 con 0x7f6c28157ae0 2023-03-06T13:49:19.936 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.853+0000 7f6c2fd33700 1 -- --> v2:172.21.15.202:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c2806b850 con 0x7f6c2806ad10 2023-03-06T13:49:19.936 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.853+0000 7f6c2e2d0700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f6c28157ae0 0x7f6c2815e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:19.936 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.853+0000 7f6c2d2ce700 1 --2- >> v2:172.21.15.202:3300/0 conn(0x7f6c2806ad10 0x7f6c281575a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:19.937 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.853+0000 7f6c2e2d0700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f6c28157ae0 0x7f6c2815e1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:38958/0 (socket says 172.21.15.86:38958) 2023-03-06T13:49:19.937 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.853+0000 7f6c2e2d0700 1 -- 172.21.15.86:0/3722544644 learned_addr learned my addr 172.21.15.86:0/3722544644 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-03-06T13:49:19.937 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.853+0000 7f6c2e2d0700 1 -- 172.21.15.86:0/3722544644 >> v2:172.21.15.202:3300/0 conn(0x7f6c2806ad10 msgr2=0x7f6c281575a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T13:49:19.938 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.853+0000 7f6c2e2d0700 1 --2- 172.21.15.86:0/3722544644 >> v2:172.21.15.202:3300/0 conn(0x7f6c2806ad10 0x7f6c281575a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:19.938 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.853+0000 7f6c2e2d0700 1 -- 172.21.15.86:0/3722544644 >> v1:172.21.15.202:6789/0 conn(0x7f6c280c2270 legacy=0x7f6c280bc530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:19.938 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.853+0000 7f6c2e2d0700 1 -- 172.21.15.86:0/3722544644 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c2806e360 con 0x7f6c28157ae0 2023-03-06T13:49:19.938 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.853+0000 7f6c2d2ce700 1 --2- 172.21.15.86:0/3722544644 >> v2:172.21.15.202:3300/0 conn(0x7f6c2806ad10 0x7f6c281575a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-06T13:49:19.939 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.853+0000 7f6c2e2d0700 1 --2- 172.21.15.86:0/3722544644 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6c28157ae0 0x7f6c2815e1e0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f6c28066e30 tx=0x7f6c18009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52c81adbd397b31b server_cookie=0 in_seq=0 out_seq=0 2023-03-06T13:49:19.939 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.854+0000 7f6c2cacd700 1 -- 172.21.15.86:0/3722544644 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c18011830 con 0x7f6c28157ae0 2023-03-06T13:49:19.940 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.854+0000 7f451bfff700 1 -- 172.21.15.86:0/2287193389 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4524011830 con 0x7f45340bd3f0 2023-03-06T13:49:19.940 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.854+0000 7f4539c11700 1 -- 172.21.15.86:0/2287193389 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45340bbe50 con 0x7f45340bd3f0 2023-03-06T13:49:19.940 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.854+0000 7f4539c11700 1 -- 172.21.15.86:0/2287193389 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45340bbb70 con 0x7f45340bd3f0 2023-03-06T13:49:19.941 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.854+0000 7f5ae6ffd700 1 -- 172.21.15.86:0/2294604524 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f5aec053be0 con 0x7f5af80c2270 2023-03-06T13:49:19.941 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.855+0000 7f4539c11700 1 -- 172.21.15.86:0/2287193389 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45340bc130 con 0x7f45340bd3f0 2023-03-06T13:49:19.942 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.857+0000 7f5290ff9700 1 -- 172.21.15.86:0/2081613494 <== mon.2 v2:172.21.15.202:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f528c0529d0 con 0x7f52940bf580 2023-03-06T13:49:19.942 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.858+0000 7fed9effd700 1 -- 172.21.15.86:0/3398209389 <== mon.1 v2:172.21.15.202:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feda0003e30 con 0x7feda80c19d0 2023-03-06T13:49:19.942 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.858+0000 7fdda67fc700 1 -- 172.21.15.86:0/3611595354 <== mon.1 v2:172.21.15.202:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fdda80713c0 con 0x7fddb00c4f80 2023-03-06T13:49:19.943 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.858+0000 7f6021ffb700 1 -- 172.21.15.86:0/124183645 <== mon.1 v2:172.21.15.202:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f601c051410 con 0x7f602c0bf1a0 2023-03-06T13:49:19.943 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.859+0000 7fbc3d7fa700 1 -- 172.21.15.86:0/4180836382 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fbc340518b0 con 0x7fbc400bd940 2023-03-06T13:49:19.943 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.858+0000 7fedb0283700 1 -- 172.21.15.86:0/3398209389 --> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feda80c1da0 con 0x7feda80c19d0 2023-03-06T13:49:19.944 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.858+0000 7fedb0283700 1 -- 172.21.15.86:0/3398209389 --> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feda8153fa0 con 0x7feda80c19d0 2023-03-06T13:49:19.944 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.860+0000 7fedb0283700 1 -- 172.21.15.86:0/3398209389 --> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feda80c1f30 con 0x7feda80c19d0 2023-03-06T13:49:19.944 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.861+0000 7f451bfff700 1 -- 172.21.15.86:0/2287193389 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45240091d0 con 0x7f45340bd3f0 2023-03-06T13:49:19.944 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.861+0000 7f451bfff700 1 -- 172.21.15.86:0/2287193389 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4524011b90 con 0x7f45340bd3f0 2023-03-06T13:49:19.945 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.862+0000 7fdda67fc700 1 -- 172.21.15.86:0/3611595354 <== mon.1 v2:172.21.15.202:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fdda8065670 con 0x7fddb00c4f80 2023-03-06T13:49:19.945 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.864+0000 7f6c2cacd700 1 -- 172.21.15.86:0/3722544644 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c18011990 con 0x7f6c28157ae0 2023-03-06T13:49:19.945 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.864+0000 7f6c2cacd700 1 -- 172.21.15.86:0/3722544644 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c18011d20 con 0x7f6c28157ae0 2023-03-06T13:49:19.945 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.865+0000 7f6c2fd33700 1 -- 172.21.15.86:0/3722544644 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6c28157ae0 msgr2=0x7f6c2815e1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:19.945 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.865+0000 7f6c2fd33700 1 --2- 172.21.15.86:0/3722544644 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6c28157ae0 0x7f6c2815e1e0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f6c28066e30 tx=0x7f6c18009bd0 comp rx=0 tx=0).stop 2023-03-06T13:49:19.946 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.862+0000 7f451bfff700 1 -- 172.21.15.86:0/2287193389 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f452400f050 con 0x7f45340bd3f0 2023-03-06T13:49:19.946 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.863+0000 7f451bfff700 1 --2- 172.21.15.86:0/2287193389 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7f45200682f0 0x7f452006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:19.946 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.863+0000 7f451bfff700 1 -- 172.21.15.86:0/2287193389 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f4524085c40 con 0x7f45340bd3f0 2023-03-06T13:49:19.946 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.864+0000 7f451bfff700 1 -- 172.21.15.86:0/2287193389 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f45240523d0 con 0x7f45340bd3f0 2023-03-06T13:49:19.946 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.862+0000 7fed9effd700 1 -- 172.21.15.86:0/3398209389 <== mon.1 v2:172.21.15.202:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feda0005070 con 0x7feda80c19d0 2023-03-06T13:49:19.947 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.862+0000 7fed9effd700 1 -- 172.21.15.86:0/3398209389 <== mon.1 v2:172.21.15.202:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feda0001910 con 0x7feda80c19d0 2023-03-06T13:49:19.947 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.865+0000 7f6c2fd33700 1 -- 172.21.15.86:0/3722544644 shutdown_connections 2023-03-06T13:49:19.947 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.865+0000 7f6c2fd33700 1 --2- 172.21.15.86:0/3722544644 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6c28157ae0 0x7f6c2815e1e0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:19.947 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.865+0000 7f6c2fd33700 1 --2- 172.21.15.86:0/3722544644 >> v2:172.21.15.202:3300/0 conn(0x7f6c2806ad10 0x7f6c281575a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:19.948 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.865+0000 7f6c2fd33700 1 -- 172.21.15.86:0/3722544644 >> 172.21.15.86:0/3722544644 conn(0x7f6c280a4180 msgr2=0x7f6c280c18f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T13:49:19.948 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.865+0000 7f6c2fd33700 1 -- 172.21.15.86:0/3722544644 shutdown_connections 2023-03-06T13:49:19.948 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.865+0000 7f6c2fd33700 1 -- 172.21.15.86:0/3722544644 wait complete. 2023-03-06T13:49:19.948 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.867+0000 7f6c2fd33700 1 Processor -- start 2023-03-06T13:49:19.948 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.868+0000 7f45337fe700 1 --2- 172.21.15.86:0/2287193389 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7f45200682f0 0x7f452006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:19.949 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.867+0000 7f6c2fd33700 1 -- start start 2023-03-06T13:49:19.949 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.868+0000 7f6c2fd33700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6c2806ad10 0x7f6c280a4840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:19.949 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.868+0000 7f6c2fd33700 1 --2- >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f6c280c2270 0x7f6c281f5450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:19.949 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.868+0000 7f6c2fd33700 1 --2- >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f6c28157ae0 0x7f6c280bb0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:19.949 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.868+0000 7f6c2fd33700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c280b7c80 con 0x7f6c2806ad10 2023-03-06T13:49:19.949 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.868+0000 7f6c2fd33700 1 -- --> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c281f6150 con 0x7f6c280c2270 2023-03-06T13:49:19.950 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.868+0000 7f6c2fd33700 1 -- --> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c280b67b0 con 0x7f6c28157ae0 2023-03-06T13:49:19.950 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.868+0000 7f6c2dacf700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6c2806ad10 0x7f6c280a4840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:19.950 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.868+0000 7f6c2dacf700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6c2806ad10 0x7f6c280a4840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:38966/0 (socket says 172.21.15.86:38966) 2023-03-06T13:49:19.950 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.868+0000 7f6c2dacf700 1 -- 172.21.15.86:0/1773344782 learned_addr learned my addr 172.21.15.86:0/1773344782 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-03-06T13:49:19.950 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.868+0000 7f6c2d2ce700 1 --2- 172.21.15.86:0/1773344782 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f6c280c2270 0x7f6c281f5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:19.950 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.868+0000 7f6c2e2d0700 1 --2- 172.21.15.86:0/1773344782 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f6c28157ae0 0x7f6c280bb0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:19.951 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.868+0000 7f45337fe700 1 --2- 172.21.15.86:0/2287193389 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7f45200682f0 0x7f452006a7a0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f45280099f0 tx=0x7f4528008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T13:49:19.951 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.869+0000 7f6c2e2d0700 1 -- 172.21.15.86:0/1773344782 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f6c280c2270 msgr2=0x7f6c281f5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:19.952 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.869+0000 7f6c2e2d0700 1 --2- 172.21.15.86:0/1773344782 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f6c280c2270 0x7f6c281f5450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:19.952 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.869+0000 7f6c2e2d0700 1 -- 172.21.15.86:0/1773344782 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6c2806ad10 msgr2=0x7f6c280a4840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:19.952 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.869+0000 7f6c2e2d0700 1 --2- 172.21.15.86:0/1773344782 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6c2806ad10 0x7f6c280a4840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:19.952 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.869+0000 7f6c2e2d0700 1 -- 172.21.15.86:0/1773344782 --> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c24009430 con 0x7f6c28157ae0 2023-03-06T13:49:19.952 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.869+0000 7f6c2dacf700 1 --2- 172.21.15.86:0/1773344782 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6c2806ad10 0x7f6c280a4840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-06T13:49:19.952 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.869+0000 7f6c2d2ce700 1 --2- 172.21.15.86:0/1773344782 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f6c280c2270 0x7f6c281f5450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-06T13:49:19.952 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.869+0000 7f6c2e2d0700 1 --2- 172.21.15.86:0/1773344782 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f6c28157ae0 0x7f6c280bb0f0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f6c28067770 tx=0x7f6c18004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T13:49:19.952 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.869+0000 7f6c1e7fc700 1 -- 172.21.15.86:0/1773344782 <== mon.2 v2:172.21.15.202:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c180044d0 con 0x7f6c28157ae0 2023-03-06T13:49:19.953 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.869+0000 7f6c1e7fc700 1 -- 172.21.15.86:0/1773344782 <== mon.2 v2:172.21.15.202:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c1801f070 con 0x7f6c28157ae0 2023-03-06T13:49:19.953 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.869+0000 7f6c2fd33700 1 -- 172.21.15.86:0/1773344782 --> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c18009550 con 0x7f6c28157ae0 2023-03-06T13:49:19.953 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.869+0000 7f6c1e7fc700 1 -- 172.21.15.86:0/1773344782 <== mon.2 v2:172.21.15.202:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c180038a0 con 0x7f6c28157ae0 2023-03-06T13:49:19.953 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.869+0000 7f6c2fd33700 1 -- 172.21.15.86:0/1773344782 --> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c280c03e0 con 0x7f6c28157ae0 2023-03-06T13:49:19.954 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.870+0000 7fed9effd700 1 -- 172.21.15.86:0/3398209389 <== mon.1 v2:172.21.15.202:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7feda0019030 con 0x7feda80c19d0 2023-03-06T13:49:19.954 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.870+0000 7fed9effd700 1 --2- 172.21.15.86:0/3398209389 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7fed8c0682f0 0x7fed8c06a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:19.954 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.870+0000 7fed9effd700 1 -- 172.21.15.86:0/3398209389 <== mon.1 v2:172.21.15.202:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7feda0085990 con 0x7feda80c19d0 2023-03-06T13:49:19.954 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.871+0000 7f6c2fd33700 1 -- 172.21.15.86:0/1773344782 --> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c280c0100 con 0x7f6c28157ae0 2023-03-06T13:49:19.955 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.870+0000 7fed9effd700 1 -- 172.21.15.86:0/3398209389 <== mon.1 v2:172.21.15.202:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7feda00b0680 con 0x7feda80c19d0 2023-03-06T13:49:19.955 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.875+0000 7f6c1e7fc700 1 -- 172.21.15.86:0/1773344782 <== mon.2 v2:172.21.15.202:3301/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f6c1800f050 con 0x7f6c28157ae0 2023-03-06T13:49:19.955 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.875+0000 7f6c1e7fc700 1 --2- 172.21.15.86:0/1773344782 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7f6c0c0682f0 0x7f6c0c06a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:19.955 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.875+0000 7f6c1e7fc700 1 -- 172.21.15.86:0/1773344782 <== mon.2 v2:172.21.15.202:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f6c18021070 con 0x7f6c28157ae0 2023-03-06T13:49:19.956 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.880+0000 7f6c2dacf700 1 --2- 172.21.15.86:0/1773344782 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7f6c0c0682f0 0x7f6c0c06a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:19.956 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.880+0000 7f6c2dacf700 1 --2- 172.21.15.86:0/1773344782 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7f6c0c0682f0 0x7f6c0c06a7a0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f6c2000e300 tx=0x7f6c20009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T13:49:19.956 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.882+0000 7fedae01f700 1 --2- 172.21.15.86:0/3398209389 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7fed8c0682f0 0x7fed8c06a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:19.956 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.882+0000 7fedae01f700 1 --2- 172.21.15.86:0/3398209389 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7fed8c0682f0 0x7fed8c06a7a0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7feda4005910 tx=0x7feda4009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T13:49:19.956 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:19.882+0000 7f6c1e7fc700 1 -- 172.21.15.86:0/1773344782 <== mon.2 v2:172.21.15.202:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f6c180b85e0 con 0x7f6c28157ae0 2023-03-06T13:49:20.243 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:20.242+0000 7fbc46d7a700 1 -- 172.21.15.86:0/4180836382 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fbc4004e750 con 0x7fbc400bd940 2023-03-06T13:49:20.244 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:20.242+0000 7fbc3d7fa700 1 -- 172.21.15.86:0/4180836382 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fbc34017030 con 0x7fbc400bd940 2023-03-06T13:49:20.246 INFO:teuthology.orchestra.run.smithi086.stdout:55834574853 2023-03-06T13:49:20.247 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:20.246+0000 7f529a776700 1 -- 172.21.15.86:0/2081613494 --> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f529404e750 con 0x7f52940bf580 2023-03-06T13:49:20.248 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:20.246+0000 7f6033a05700 1 -- 172.21.15.86:0/124183645 --> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f602c0befd0 con 0x7f602c0bf1a0 2023-03-06T13:49:20.248 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:20.246+0000 7f5afc9f2700 1 -- 172.21.15.86:0/2294604524 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f5ad80055c0 con 0x7f5af80c2270 2023-03-06T13:49:20.248 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:20.246+0000 7fbc46d7a700 1 -- 172.21.15.86:0/4180836382 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7fbc2c068340 msgr2=0x7fbc2c06a7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:20.248 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:20.246+0000 7fbc46d7a700 1 --2- 172.21.15.86:0/4180836382 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7fbc2c068340 0x7fbc2c06a7f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fbc38015040 tx=0x7fbc38009000 comp rx=0 tx=0).stop 2023-03-06T13:49:20.249 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:20.246+0000 7fbc46d7a700 1 -- 172.21.15.86:0/4180836382 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbc400bd940 msgr2=0x7fbc4013e720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:20.249 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:20.246+0000 7fbc46d7a700 1 --2- 172.21.15.86:0/4180836382 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbc400bd940 0x7fbc4013e720 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fbc3400c4a0 tx=0x7fbc3400c7b0 comp rx=0 tx=0).stop 2023-03-06T13:49:20.249 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:20.246+0000 7f5ae6ffd700 1 -- 172.21.15.86:0/2294604524 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5aec006d20 con 0x7f5af80c2270 2023-03-06T13:49:20.249 INFO:teuthology.orchestra.run.smithi086.stdout:55834574854 2023-03-06T13:49:20.250 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:20.246+0000 7f5290ff9700 1 -- 172.21.15.86:0/2081613494 <== mon.2 v2:172.21.15.202:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f528c055ff0 con 0x7f52940bf580 2023-03-06T13:49:20.250 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:20.246+0000 7fbc46d7a700 1 -- 172.21.15.86:0/4180836382 shutdown_connections 2023-03-06T13:49:20.250 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:20.246+0000 7fbc46d7a700 1 --2- 172.21.15.86:0/4180836382 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7fbc2c068340 0x7fbc2c06a7f0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:20.250 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:20.246+0000 7fbc46d7a700 1 --2- 172.21.15.86:0/4180836382 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fbc401543d0 0x7fbc4013b8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:20.251 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:20.246+0000 7fbc46d7a700 1 --2- 172.21.15.86:0/4180836382 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7fbc4006aa40 0x7fbc401410b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:20.251 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:20.246+0000 7fbc46d7a700 1 --2- 172.21.15.86:0/4180836382 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbc400bd940 0x7fbc4013e720 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:20.251 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:20.246+0000 7fbc46d7a700 1 -- 172.21.15.86:0/4180836382 >> 172.21.15.86:0/4180836382 conn(0x7fbc4006b440 msgr2=0x7fbc40070fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T13:49:20.251 INFO:teuthology.orchestra.run.smithi086.stdout:55834574852 2023-03-06T13:49:20.252 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:20.247+0000 7fbc46d7a700 1 -- 172.21.15.86:0/4180836382 shutdown_connections 2023-03-06T13:49:20.252 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:20.247+0000 7fbc46d7a700 1 -- 172.21.15.86:0/4180836382 wait complete. 2023-03-06T13:49:20.252 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:20.248+0000 7f6021ffb700 1 -- 172.21.15.86:0/124183645 <== mon.1 v2:172.21.15.202:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f601c017090 con 0x7f602c0bf1a0 2023-03-06T13:49:20.253 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:20.248+0000 7fddb7ed7700 1 -- 172.21.15.86:0/3611595354 --> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7fddb004e750 con 0x7fddb00c4f80 2023-03-06T13:49:20.253 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:20.249+0000 7fdda67fc700 1 -- 172.21.15.86:0/3611595354 <== mon.1 v2:172.21.15.202:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fdda803c070 con 0x7fddb00c4f80 2023-03-06T13:49:20.253 INFO:teuthology.orchestra.run.smithi086.stdout:55834574854 2023-03-06T13:49:20.254 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:20.252+0000 7fddb7ed7700 1 -- 172.21.15.86:0/3611595354 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7fdd94068340 msgr2=0x7fdd9406a7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:20.254 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:20.252+0000 7fddb7ed7700 1 --2- 172.21.15.86:0/3611595354 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7fdd94068340 0x7fdd9406a7f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fdda0000f60 tx=0x7fdda0007a70 comp rx=0 tx=0).stop 2023-03-06T13:49:20.254 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:20.252+0000 7fddb7ed7700 1 -- 172.21.15.86:0/3611595354 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7fddb00c4f80 msgr2=0x7fddb01dd230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:20.254 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:20.252+0000 7fddb7ed7700 1 --2- 172.21.15.86:0/3611595354 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7fddb00c4f80 0x7fddb01dd230 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fdda800b730 tx=0x7fdda8004ad0 comp rx=0 tx=0).stop 2023-03-06T13:49:20.254 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:20.252+0000 7fddb7ed7700 1 -- 172.21.15.86:0/3611595354 shutdown_connections 2023-03-06T13:49:20.254 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:20.252+0000 7fddb7ed7700 1 --2- 172.21.15.86:0/3611595354 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7fdd94068340 0x7fdd9406a7f0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:20.254 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:20.252+0000 7fddb7ed7700 1 --2- 172.21.15.86:0/3611595354 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fddb00c1f10 0x7fddb00a4f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:20.255 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:20.252+0000 7fddb7ed7700 1 --2- 172.21.15.86:0/3611595354 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7fddb00c4f80 0x7fddb01dd230 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:20.255 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:20.252+0000 7fddb7ed7700 1 --2- 172.21.15.86:0/3611595354 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fddb00c29f0 0x7fddb01dccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:20.255 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:20.252+0000 7fddb7ed7700 1 -- 172.21.15.86:0/3611595354 >> 172.21.15.86:0/3611595354 conn(0x7fddb006b750 msgr2=0x7fddb00aa680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T13:49:20.257 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:20.255+0000 7f529a776700 1 -- 172.21.15.86:0/2081613494 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7f52740682f0 msgr2=0x7f527406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:20.257 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:20.255+0000 7f529a776700 1 --2- 172.21.15.86:0/2081613494 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7f52740682f0 0x7f527406a7a0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f52940700b0 tx=0x7f5284009190 comp rx=0 tx=0).stop 2023-03-06T13:49:20.257 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:20.255+0000 7f529a776700 1 -- 172.21.15.86:0/2081613494 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f52940bf580 msgr2=0x7f52941e9ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:20.257 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:20.255+0000 7f529a776700 1 --2- 172.21.15.86:0/2081613494 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f52940bf580 0x7f52941e9ea0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f528c007e60 tx=0x7f528c00e3c0 comp rx=0 tx=0).stop 2023-03-06T13:49:20.258 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:20.252+0000 7fddb7ed7700 1 -- 172.21.15.86:0/3611595354 shutdown_connections 2023-03-06T13:49:20.258 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:20.253+0000 7f5afc9f2700 1 -- 172.21.15.86:0/2294604524 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7f5ae00687b0 msgr2=0x7f5ae006ac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:20.258 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:20.253+0000 7f5afc9f2700 1 --2- 172.21.15.86:0/2294604524 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7f5ae00687b0 0x7f5ae006ac60 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f5ae8007fd0 tx=0x7f5ae8007940 comp rx=0 tx=0).stop 2023-03-06T13:49:20.258 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:20.253+0000 7f5afc9f2700 1 -- 172.21.15.86:0/2294604524 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5af80c2270 msgr2=0x7f5af80bb080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:20.258 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:20.253+0000 7f5afc9f2700 1 --2- 172.21.15.86:0/2294604524 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5af80c2270 0x7f5af80bb080 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f5aec009c40 tx=0x7f5aec004750 comp rx=0 tx=0).stop 2023-03-06T13:49:20.259 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:20.253+0000 7f5afc9f2700 1 -- 172.21.15.86:0/2294604524 shutdown_connections 2023-03-06T13:49:20.259 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:20.253+0000 7f5afc9f2700 1 --2- 172.21.15.86:0/2294604524 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7f5ae00687b0 0x7f5ae006ac60 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:20.259 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:20.253+0000 7f5afc9f2700 1 --2- 172.21.15.86:0/2294604524 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f5af8157ae0 0x7f5af80b7ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:20.259 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:20.253+0000 7f5afc9f2700 1 --2- 172.21.15.86:0/2294604524 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f5af806ad10 0x7f5af80a5c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:20.259 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:20.253+0000 7f5afc9f2700 1 --2- 172.21.15.86:0/2294604524 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5af80c2270 0x7f5af80bb080 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:20.259 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:20.253+0000 7f5afc9f2700 1 -- 172.21.15.86:0/2294604524 >> 172.21.15.86:0/2294604524 conn(0x7f5af80a4180 msgr2=0x7f5af80bc450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T13:49:20.259 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:20.253+0000 7f5afc9f2700 1 -- 172.21.15.86:0/2294604524 shutdown_connections 2023-03-06T13:49:20.260 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:20.253+0000 7f5afc9f2700 1 -- 172.21.15.86:0/2294604524 wait complete. 2023-03-06T13:49:20.260 INFO:teuthology.orchestra.run.smithi086.stdout:55834574854 2023-03-06T13:49:20.261 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:20.252+0000 7fddb7ed7700 1 -- 172.21.15.86:0/3611595354 wait complete. 2023-03-06T13:49:20.262 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:20.255+0000 7f6033a05700 1 -- 172.21.15.86:0/124183645 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7f60100682f0 msgr2=0x7f601006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:20.262 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:20.255+0000 7f6033a05700 1 --2- 172.21.15.86:0/124183645 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7f60100682f0 0x7f601006a7a0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f602c06d780 tx=0x7f6024009000 comp rx=0 tx=0).stop 2023-03-06T13:49:20.262 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:20.255+0000 7f6033a05700 1 -- 172.21.15.86:0/124183645 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f602c0bf1a0 msgr2=0x7f602c0bf610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:20.262 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:20.255+0000 7f6033a05700 1 --2- 172.21.15.86:0/124183645 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f602c0bf1a0 0x7f602c0bf610 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f601c00c360 tx=0x7f601c00c670 comp rx=0 tx=0).stop 2023-03-06T13:49:20.262 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:20.256+0000 7f6033a05700 1 -- 172.21.15.86:0/124183645 shutdown_connections 2023-03-06T13:49:20.263 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:20.256+0000 7f6033a05700 1 --2- 172.21.15.86:0/124183645 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7f60100682f0 0x7f601006a7a0 secure :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f602c06d780 tx=0x7f6024009000 comp rx=0 tx=0).stop 2023-03-06T13:49:20.263 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:20.256+0000 7f6033a05700 1 --2- 172.21.15.86:0/124183645 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f602c0b5fd0 0x7f602c06f730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:20.263 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:20.256+0000 7f6033a05700 1 --2- 172.21.15.86:0/124183645 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f602c0bf1a0 0x7f602c0bf610 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:20.263 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:20.256+0000 7f6033a05700 1 --2- 172.21.15.86:0/124183645 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f602c0bd3f0 0x7f602c0707e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:20.263 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:20.256+0000 7f6033a05700 1 -- 172.21.15.86:0/124183645 >> 172.21.15.86:0/124183645 conn(0x7f602c06afc0 msgr2=0x7f602c0b9320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T13:49:20.264 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:20.260+0000 7f529a776700 1 -- 172.21.15.86:0/2081613494 shutdown_connections 2023-03-06T13:49:20.264 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:20.260+0000 7f529a776700 1 --2- 172.21.15.86:0/2081613494 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7f52740682f0 0x7f527406a7a0 secure :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f52940700b0 tx=0x7f5284009190 comp rx=0 tx=0).stop 2023-03-06T13:49:20.264 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:20.260+0000 7f529a776700 1 --2- 172.21.15.86:0/2081613494 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f52941543d0 0x7f52941466f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:20.264 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:20.260+0000 7f529a776700 1 --2- 172.21.15.86:0/2081613494 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f52940bd940 0x7f529414e1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:20.264 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:20.260+0000 7f529a776700 1 --2- 172.21.15.86:0/2081613494 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f52940bf580 0x7f52941e9ea0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:20.264 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:20.260+0000 7f529a776700 1 -- 172.21.15.86:0/2081613494 >> 172.21.15.86:0/2081613494 conn(0x7f529406b440 msgr2=0x7f5294152b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T13:49:20.265 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:20.260+0000 7f6033a05700 1 -- 172.21.15.86:0/124183645 shutdown_connections 2023-03-06T13:49:20.265 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:20.260+0000 7f6c2fd33700 1 -- 172.21.15.86:0/1773344782 --> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f6c280c12c0 con 0x7f6c28157ae0 2023-03-06T13:49:20.266 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:20.261+0000 7f6033a05700 1 -- 172.21.15.86:0/124183645 wait complete. 2023-03-06T13:49:20.266 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:20.261+0000 7f529a776700 1 -- 172.21.15.86:0/2081613494 shutdown_connections 2023-03-06T13:49:20.266 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:20.261+0000 7f529a776700 1 -- 172.21.15.86:0/2081613494 wait complete. 2023-03-06T13:49:20.267 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:20.261+0000 7f6c1e7fc700 1 -- 172.21.15.86:0/1773344782 <== mon.2 v2:172.21.15.202:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f6c18015090 con 0x7f6c28157ae0 2023-03-06T13:49:20.267 INFO:teuthology.orchestra.run.smithi086.stdout:55834574854 2023-03-06T13:49:20.268 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:20.265+0000 7f6c2fd33700 1 -- 172.21.15.86:0/1773344782 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7f6c0c0682f0 msgr2=0x7f6c0c06a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:20.268 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:20.265+0000 7f6c2fd33700 1 --2- 172.21.15.86:0/1773344782 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7f6c0c0682f0 0x7f6c0c06a7a0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f6c2000e300 tx=0x7f6c20009040 comp rx=0 tx=0).stop 2023-03-06T13:49:20.268 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:20.265+0000 7f6c2fd33700 1 -- 172.21.15.86:0/1773344782 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f6c28157ae0 msgr2=0x7f6c280bb0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:20.268 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:20.265+0000 7f6c2fd33700 1 --2- 172.21.15.86:0/1773344782 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f6c28157ae0 0x7f6c280bb0f0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f6c28067770 tx=0x7f6c18004750 comp rx=0 tx=0).stop 2023-03-06T13:49:20.268 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:20.265+0000 7f6c2fd33700 1 -- 172.21.15.86:0/1773344782 shutdown_connections 2023-03-06T13:49:20.269 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:20.265+0000 7f6c2fd33700 1 --2- 172.21.15.86:0/1773344782 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7f6c0c0682f0 0x7f6c0c06a7a0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:20.269 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:20.265+0000 7f6c2fd33700 1 --2- 172.21.15.86:0/1773344782 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6c2806ad10 0x7f6c280a4840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:20.269 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:20.265+0000 7f6c2fd33700 1 --2- 172.21.15.86:0/1773344782 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f6c28157ae0 0x7f6c280bb0f0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:20.269 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:20.265+0000 7f6c2fd33700 1 --2- 172.21.15.86:0/1773344782 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f6c280c2270 0x7f6c281f5450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:20.269 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:20.265+0000 7f6c2fd33700 1 -- 172.21.15.86:0/1773344782 >> 172.21.15.86:0/1773344782 conn(0x7f6c280a4180 msgr2=0x7f6c28070030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T13:49:20.270 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:20.266+0000 7fedb0283700 1 -- 172.21.15.86:0/3398209389 --> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7feda8071440 con 0x7feda80c19d0 2023-03-06T13:49:20.270 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:20.266+0000 7f4539c11700 1 -- 172.21.15.86:0/2287193389 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f453404e750 con 0x7f45340bd3f0 2023-03-06T13:49:20.270 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:20.266+0000 7fed9effd700 1 -- 172.21.15.86:0/3398209389 <== mon.1 v2:172.21.15.202:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7feda0017020 con 0x7feda80c19d0 2023-03-06T13:49:20.271 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:20.267+0000 7f451bfff700 1 -- 172.21.15.86:0/2287193389 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f45240559f0 con 0x7f45340bd3f0 2023-03-06T13:49:20.272 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.4 2023-03-06T13:49:20.272 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:20.268+0000 7f6c2fd33700 1 -- 172.21.15.86:0/1773344782 shutdown_connections 2023-03-06T13:49:20.272 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:20.268+0000 7f6c2fd33700 1 -- 172.21.15.86:0/1773344782 wait complete. 2023-03-06T13:49:20.272 INFO:teuthology.orchestra.run.smithi086.stdout:55834574854 2023-03-06T13:49:20.273 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.3 2023-03-06T13:49:20.274 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:20.271+0000 7fedb0283700 1 -- 172.21.15.86:0/3398209389 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7fed8c0682f0 msgr2=0x7fed8c06a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:20.274 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:20.271+0000 7fedb0283700 1 --2- 172.21.15.86:0/3398209389 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7fed8c0682f0 0x7fed8c06a7a0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7feda4005910 tx=0x7feda4009040 comp rx=0 tx=0).stop 2023-03-06T13:49:20.274 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:20.271+0000 7fedb0283700 1 -- 172.21.15.86:0/3398209389 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7feda80c19d0 msgr2=0x7feda81508a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:20.274 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:20.271+0000 7fedb0283700 1 --2- 172.21.15.86:0/3398209389 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7feda80c19d0 0x7feda81508a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7feda0001560 tx=0x7feda000cc00 comp rx=0 tx=0).stop 2023-03-06T13:49:20.275 INFO:teuthology.orchestra.run.smithi086.stdout:55834574854 2023-03-06T13:49:20.276 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:20.274+0000 7fedb0283700 1 -- 172.21.15.86:0/3398209389 shutdown_connections 2023-03-06T13:49:20.276 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:20.274+0000 7fedb0283700 1 --2- 172.21.15.86:0/3398209389 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7fed8c0682f0 0x7fed8c06a7a0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:20.276 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:20.274+0000 7fedb0283700 1 --2- 172.21.15.86:0/3398209389 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7feda80c19d0 0x7feda81508a0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:20.276 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:20.274+0000 7fedb0283700 1 --2- 172.21.15.86:0/3398209389 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7feda80a6e80 0x7feda81ec1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:20.276 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:20.274+0000 7fedb0283700 1 --2- 172.21.15.86:0/3398209389 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feda80bd6e0 0x7feda814f800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:20.276 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:20.274+0000 7fedb0283700 1 -- 172.21.15.86:0/3398209389 >> 172.21.15.86:0/3398209389 conn(0x7feda806afc0 msgr2=0x7feda80bb8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T13:49:20.277 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:20.274+0000 7fedb0283700 1 -- 172.21.15.86:0/3398209389 shutdown_connections 2023-03-06T13:49:20.277 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:20.274+0000 7fedb0283700 1 -- 172.21.15.86:0/3398209389 wait complete. 2023-03-06T13:49:20.278 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:20.276+0000 7f4539c11700 1 -- 172.21.15.86:0/2287193389 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7f45200682f0 msgr2=0x7f452006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:20.278 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:20.276+0000 7f4539c11700 1 --2- 172.21.15.86:0/2287193389 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7f45200682f0 0x7f452006a7a0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f45280099f0 tx=0x7f4528008040 comp rx=0 tx=0).stop 2023-03-06T13:49:20.278 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:20.276+0000 7f4539c11700 1 -- 172.21.15.86:0/2287193389 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f45340bd3f0 msgr2=0x7f453413ed30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:20.279 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:20.276+0000 7f4539c11700 1 --2- 172.21.15.86:0/2287193389 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f45340bd3f0 0x7f453413ed30 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f452400b420 tx=0x7f452400b7e0 comp rx=0 tx=0).stop 2023-03-06T13:49:20.279 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:20.277+0000 7f4539c11700 1 -- 172.21.15.86:0/2287193389 shutdown_connections 2023-03-06T13:49:20.279 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:20.277+0000 7f4539c11700 1 --2- 172.21.15.86:0/2287193389 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7f45200682f0 0x7f452006a7a0 secure :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f45280099f0 tx=0x7f4528008040 comp rx=0 tx=0).stop 2023-03-06T13:49:20.279 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:20.277+0000 7f4539c11700 1 --2- 172.21.15.86:0/2287193389 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f4534145510 0x7f453413f270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:20.279 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:20.277+0000 7f4539c11700 1 --2- 172.21.15.86:0/2287193389 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f45340b5fd0 0x7f45340bf690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:20.279 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:20.277+0000 7f4539c11700 1 --2- 172.21.15.86:0/2287193389 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f45340bd3f0 0x7f453413ed30 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:20.279 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:20.277+0000 7f4539c11700 1 -- 172.21.15.86:0/2287193389 >> 172.21.15.86:0/2287193389 conn(0x7f453406afc0 msgr2=0x7f45340ba810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T13:49:20.280 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:20.277+0000 7f4539c11700 1 -- 172.21.15.86:0/2287193389 shutdown_connections 2023-03-06T13:49:20.280 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:20.277+0000 7f4539c11700 1 -- 172.21.15.86:0/2287193389 wait complete. 2023-03-06T13:49:20.284 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.6 2023-03-06T13:49:20.285 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.2 2023-03-06T13:49:20.287 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.0 2023-03-06T13:49:20.293 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.1 2023-03-06T13:49:20.298 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.5 2023-03-06T13:49:20.298 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.7 2023-03-06T13:49:21.272 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-03-06T13:49:21.275 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-03-06T13:49:21.285 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-03-06T13:49:21.287 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-03-06T13:49:21.287 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-03-06T13:49:21.294 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-03-06T13:49:21.299 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-03-06T13:49:21.300 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-03-06T13:49:21.473 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.467+0000 7fa738afd700 1 Processor -- start 2023-03-06T13:49:21.473 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.467+0000 7fa738afd700 1 -- start start 2023-03-06T13:49:21.473 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.469+0000 7fa738afd700 1 --2- >> v2:172.21.15.202:3300/0 conn(0x7fa7340b5fd0 0x7fa73414f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:21.474 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.469+0000 7fa738afd700 1 --2- >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fa7340bd3f0 0x7fa7340bc930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:21.474 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.469+0000 7fa738afd700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7340bc4a0 con 0x7fa734145510 2023-03-06T13:49:21.474 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.469+0000 7fa738afd700 1 -- --> v2:172.21.15.202:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7340b7e40 con 0x7fa7340b5fd0 2023-03-06T13:49:21.474 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.469+0000 7fa738afd700 1 -- --> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa73414f6d0 con 0x7fa7340bd3f0 2023-03-06T13:49:21.475 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.469+0000 7fa732d9d700 1 --2- >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fa7340bd3f0 0x7fa7340bc930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:21.475 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.469+0000 7fa732d9d700 1 --2- >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fa7340bd3f0 0x7fa7340bc930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.202:3301/0 says I am v2:172.21.15.86:50666/0 (socket says 172.21.15.86:50666) 2023-03-06T13:49:21.475 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.469+0000 7fa732d9d700 1 -- 172.21.15.86:0/477645304 learned_addr learned my addr 172.21.15.86:0/477645304 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-03-06T13:49:21.475 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.469+0000 7fa731d9b700 1 --2- 172.21.15.86:0/477645304 >> v2:172.21.15.202:3300/0 conn(0x7fa7340b5fd0 0x7fa73414f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:21.475 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.470+0000 7fa732d9d700 1 -- 172.21.15.86:0/477645304 >> v2:172.21.15.202:3300/0 conn(0x7fa7340b5fd0 msgr2=0x7fa73414f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T13:49:21.476 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.470+0000 7fa732d9d700 1 --2- 172.21.15.86:0/477645304 >> v2:172.21.15.202:3300/0 conn(0x7fa7340b5fd0 0x7fa73414f0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:21.476 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.470+0000 7fa732d9d700 1 -- 172.21.15.86:0/477645304 >> v1:172.21.15.86:6789/0 conn(0x7fa734145510 legacy=0x7fa73406c8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T13:49:21.476 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.470+0000 7fa732d9d700 1 -- 172.21.15.86:0/477645304 --> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7341458e0 con 0x7fa7340bd3f0 2023-03-06T13:49:21.477 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.470+0000 7fa732d9d700 1 --2- 172.21.15.86:0/477645304 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fa7340bd3f0 0x7fa7340bc930 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fa72c00d370 tx=0x7fa72c00d680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f9263ae215327d07 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T13:49:21.478 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.471+0000 7fa73159a700 1 -- 172.21.15.86:0/477645304 <== mon.2 v2:172.21.15.202:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa72c010070 con 0x7fa7340bd3f0 2023-03-06T13:49:21.478 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.471+0000 7fa73159a700 1 -- 172.21.15.86:0/477645304 <== mon.2 v2:172.21.15.202:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa72c00dc20 con 0x7fa7340bd3f0 2023-03-06T13:49:21.478 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.471+0000 7fa73159a700 1 -- 172.21.15.86:0/477645304 <== mon.2 v2:172.21.15.202:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa72c007b30 con 0x7fa7340bd3f0 2023-03-06T13:49:21.478 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.472+0000 7fa738afd700 1 -- 172.21.15.86:0/477645304 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fa7340bd3f0 msgr2=0x7fa7340bc930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:21.479 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.472+0000 7fa738afd700 1 --2- 172.21.15.86:0/477645304 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fa7340bd3f0 0x7fa7340bc930 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fa72c00d370 tx=0x7fa72c00d680 comp rx=0 tx=0).stop 2023-03-06T13:49:21.479 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.472+0000 7fa738afd700 1 -- 172.21.15.86:0/477645304 shutdown_connections 2023-03-06T13:49:21.479 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.472+0000 7fa738afd700 1 --2- 172.21.15.86:0/477645304 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fa7340bd3f0 0x7fa7340bc930 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:21.479 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.472+0000 7fa738afd700 1 --2- 172.21.15.86:0/477645304 >> v2:172.21.15.202:3300/0 conn(0x7fa7340b5fd0 0x7fa73414f0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:21.480 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.472+0000 7fa738afd700 1 -- 172.21.15.86:0/477645304 >> 172.21.15.86:0/477645304 conn(0x7fa73406afc0 msgr2=0x7fa7340c1050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T13:49:21.480 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.473+0000 7fa738afd700 1 -- 172.21.15.86:0/477645304 shutdown_connections 2023-03-06T13:49:21.480 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.474+0000 7fa738afd700 1 -- 172.21.15.86:0/477645304 wait complete. 2023-03-06T13:49:21.480 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.476+0000 7fa738afd700 1 Processor -- start 2023-03-06T13:49:21.481 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.476+0000 7fae3b7bc700 1 Processor -- start 2023-03-06T13:49:21.481 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.476+0000 7fa738afd700 1 -- start start 2023-03-06T13:49:21.482 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.477+0000 7fa738afd700 1 --2- >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7fa7340b5fd0 0x7fa7340c0d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:21.482 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.477+0000 7fa738afd700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa7340bd3f0 0x7fa7341dffd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:21.482 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.477+0000 7fa738afd700 1 --2- >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fa73413f820 0x7fa734140aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:21.483 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.477+0000 7fa738afd700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7340c0440 con 0x7fa7340bd3f0 2023-03-06T13:49:21.483 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.477+0000 7fa738afd700 1 -- --> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7340c1280 con 0x7fa7340b5fd0 2023-03-06T13:49:21.483 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.477+0000 7fa738afd700 1 -- --> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa73413ebf0 con 0x7fa73413f820 2023-03-06T13:49:21.483 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.477+0000 7fa731d9b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa7340bd3f0 0x7fa7341dffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:21.484 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.477+0000 7fa731d9b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa7340bd3f0 0x7fa7341dffd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:38980/0 (socket says 172.21.15.86:38980) 2023-03-06T13:49:21.484 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.477+0000 7fa731d9b700 1 -- 172.21.15.86:0/146585678 learned_addr learned my addr 172.21.15.86:0/146585678 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-03-06T13:49:21.484 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.477+0000 7fa732d9d700 1 --2- 172.21.15.86:0/146585678 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fa73413f820 0x7fa734140aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:21.485 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.476+0000 7fae3b7bc700 1 -- start start 2023-03-06T13:49:21.485 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.478+0000 7fae3b7bc700 1 --2- >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fae34145510 0x7fae3414f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:21.485 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.478+0000 7fae3b7bc700 1 --2- >> v2:172.21.15.202:3300/0 conn(0x7fae340b5fd0 0x7fae340bc930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:21.486 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.478+0000 7fae3b7bc700 1 -- --> v1:172.21.15.202:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae340bc4a0 con 0x7fae340bd3f0 2023-03-06T13:49:21.486 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.478+0000 7fae3b7bc700 1 -- --> v2:172.21.15.202:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae340b7e40 con 0x7fae340b5fd0 2023-03-06T13:49:21.486 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.478+0000 7fae3b7bc700 1 -- --> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae3414f6d0 con 0x7fae34145510 2023-03-06T13:49:21.486 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.478+0000 7fae39d59700 1 --1- >> v1:172.21.15.202:6789/0 conn(0x7fae340bd3f0 0x7fae3406c8a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.202:6789/0 says I am v1:172.21.15.86:48190/0 (socket says 172.21.15.86:48190) 2023-03-06T13:49:21.487 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.478+0000 7fae39d59700 1 -- 172.21.15.86:0/1238943735 learned_addr learned my addr 172.21.15.86:0/1238943735 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-03-06T13:49:21.487 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.478+0000 7fae38d57700 1 --2- 172.21.15.86:0/1238943735 >> v2:172.21.15.202:3300/0 conn(0x7fae340b5fd0 0x7fae340bc930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:21.487 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.478+0000 7fae39558700 1 --2- 172.21.15.86:0/1238943735 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fae34145510 0x7fae3414f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:21.488 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.478+0000 7fa732d9d700 1 -- 172.21.15.86:0/146585678 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7fa7340b5fd0 msgr2=0x7fa7340c0d40 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-03-06T13:49:21.488 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.478+0000 7fa732d9d700 1 --2- 172.21.15.86:0/146585678 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7fa7340b5fd0 0x7fa7340c0d40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:21.489 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.478+0000 7fa732d9d700 1 -- 172.21.15.86:0/146585678 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa7340bd3f0 msgr2=0x7fa7341dffd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:21.489 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.478+0000 7fa732d9d700 1 --2- 172.21.15.86:0/146585678 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa7340bd3f0 0x7fa7341dffd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:21.489 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.478+0000 7fa732d9d700 1 -- 172.21.15.86:0/146585678 --> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa72c00d050 con 0x7fa73413f820 2023-03-06T13:49:21.490 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.478+0000 7fae38d57700 1 -- 172.21.15.86:0/1238943735 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fae34145510 msgr2=0x7fae3414f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T13:49:21.490 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.478+0000 7fae38d57700 1 --2- 172.21.15.86:0/1238943735 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fae34145510 0x7fae3414f0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:21.490 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.479+0000 7fae38d57700 1 -- 172.21.15.86:0/1238943735 >> v1:172.21.15.202:6789/0 conn(0x7fae340bd3f0 legacy=0x7fae3406c8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:21.490 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.479+0000 7fae2bfff700 1 -- 172.21.15.86:0/1238943735 <== mon.1 v1:172.21.15.202:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3967809491 0 0) 0x7fae340bc4a0 con 0x7fae340bd3f0 2023-03-06T13:49:21.491 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.479+0000 7fae38d57700 1 -- 172.21.15.86:0/1238943735 --> v2:172.21.15.202:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae341458e0 con 0x7fae340b5fd0 2023-03-06T13:49:21.491 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.480+0000 7fae38d57700 1 --2- 172.21.15.86:0/1238943735 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7fae340b5fd0 0x7fae340bc930 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fae30009870 tx=0x7fae30009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cca3c7ab7687dc79 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T13:49:21.492 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.479+0000 7fa732d9d700 1 --2- 172.21.15.86:0/146585678 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fa73413f820 0x7fa734140aa0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fa72c017000 tx=0x7fa72c004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T13:49:21.492 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.479+0000 7fa722ffd700 1 -- 172.21.15.86:0/146585678 <== mon.2 v2:172.21.15.202:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa72c024070 con 0x7fa73413f820 2023-03-06T13:49:21.492 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.479+0000 7fa722ffd700 1 -- 172.21.15.86:0/146585678 <== mon.2 v2:172.21.15.202:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa72c003d30 con 0x7fa73413f820 2023-03-06T13:49:21.492 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.479+0000 7fa722ffd700 1 -- 172.21.15.86:0/146585678 <== mon.2 v2:172.21.15.202:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa72c003ea0 con 0x7fa73413f820 2023-03-06T13:49:21.493 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.479+0000 7fa738afd700 1 -- 172.21.15.86:0/146585678 --> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7340bbe50 con 0x7fa73413f820 2023-03-06T13:49:21.493 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.479+0000 7fa738afd700 1 -- 172.21.15.86:0/146585678 --> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7340bbb70 con 0x7fa73413f820 2023-03-06T13:49:21.494 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.481+0000 7fae2bfff700 1 -- 172.21.15.86:0/1238943735 <== mon.1 v2:172.21.15.202:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae30010800 con 0x7fae340b5fd0 2023-03-06T13:49:21.494 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.481+0000 7fae2bfff700 1 -- 172.21.15.86:0/1238943735 <== mon.1 v2:172.21.15.202:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae30010960 con 0x7fae340b5fd0 2023-03-06T13:49:21.494 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.481+0000 7fae2bfff700 1 -- 172.21.15.86:0/1238943735 <== mon.1 v2:172.21.15.202:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae30010cf0 con 0x7fae340b5fd0 2023-03-06T13:49:21.495 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.482+0000 7fae3b7bc700 1 -- 172.21.15.86:0/1238943735 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7fae340b5fd0 msgr2=0x7fae340bc930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:21.495 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.482+0000 7fae3b7bc700 1 --2- 172.21.15.86:0/1238943735 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7fae340b5fd0 0x7fae340bc930 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fae30009870 tx=0x7fae30009b80 comp rx=0 tx=0).stop 2023-03-06T13:49:21.495 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.482+0000 7fae3b7bc700 1 -- 172.21.15.86:0/1238943735 shutdown_connections 2023-03-06T13:49:21.496 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.482+0000 7fae3b7bc700 1 --2- 172.21.15.86:0/1238943735 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fae34145510 0x7fae3414f0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:21.496 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.482+0000 7fae3b7bc700 1 --2- 172.21.15.86:0/1238943735 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7fae340b5fd0 0x7fae340bc930 secure :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fae30009870 tx=0x7fae30009b80 comp rx=0 tx=0).stop 2023-03-06T13:49:21.496 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.482+0000 7fae3b7bc700 1 -- 172.21.15.86:0/1238943735 >> 172.21.15.86:0/1238943735 conn(0x7fae3406afc0 msgr2=0x7fae340c1050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T13:49:21.497 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.482+0000 7fa722ffd700 1 -- 172.21.15.86:0/146585678 <== mon.2 v2:172.21.15.202:3301/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fa72c01c030 con 0x7fa73413f820 2023-03-06T13:49:21.497 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.482+0000 7fa722ffd700 1 --2- 172.21.15.86:0/146585678 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7fa714068390 0x7fa71406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:21.497 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.482+0000 7fa722ffd700 1 -- 172.21.15.86:0/146585678 <== mon.2 v2:172.21.15.202:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa72c087080 con 0x7fa73413f820 2023-03-06T13:49:21.498 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.483+0000 7fae3b7bc700 1 -- 172.21.15.86:0/1238943735 shutdown_connections 2023-03-06T13:49:21.499 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.484+0000 7fa73259c700 1 --2- 172.21.15.86:0/146585678 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7fa714068390 0x7fa71406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:21.499 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.484+0000 7fa73259c700 1 --2- 172.21.15.86:0/146585678 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7fa714068390 0x7fa71406a840 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fa734067dc0 tx=0x7fa728007a20 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T13:49:21.500 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.483+0000 7fae3b7bc700 1 -- 172.21.15.86:0/1238943735 wait complete. 2023-03-06T13:49:21.500 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.485+0000 7fae3b7bc700 1 Processor -- start 2023-03-06T13:49:21.501 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.485+0000 7fae3b7bc700 1 -- start start 2023-03-06T13:49:21.501 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.486+0000 7fae3b7bc700 1 --2- >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7fae340bd3f0 0x7fae3413e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:21.501 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.486+0000 7fae3b7bc700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fae34145510 0x7fae34146080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:21.501 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.486+0000 7fae3b7bc700 1 --2- >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fae341396b0 0x7fae341465c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:21.502 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.486+0000 7fae3b7bc700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae34071ab0 con 0x7fae34145510 2023-03-06T13:49:21.502 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.486+0000 7fae3b7bc700 1 -- --> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae34145bf0 con 0x7fae340bd3f0 2023-03-06T13:49:21.502 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.486+0000 7fae3b7bc700 1 -- --> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae3413ede0 con 0x7fae341396b0 2023-03-06T13:49:21.502 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.486+0000 7fae38d57700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fae34145510 0x7fae34146080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:21.503 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.486+0000 7fae38d57700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fae34145510 0x7fae34146080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:38992/0 (socket says 172.21.15.86:38992) 2023-03-06T13:49:21.503 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.486+0000 7fae38d57700 1 -- 172.21.15.86:0/3243000203 learned_addr learned my addr 172.21.15.86:0/3243000203 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-03-06T13:49:21.503 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.487+0000 7fae38d57700 1 -- 172.21.15.86:0/3243000203 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fae341396b0 msgr2=0x7fae341465c0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-03-06T13:49:21.503 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.487+0000 7fae38d57700 1 --2- 172.21.15.86:0/3243000203 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fae341396b0 0x7fae341465c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:21.503 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.487+0000 7fae38d57700 1 -- 172.21.15.86:0/3243000203 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7fae340bd3f0 msgr2=0x7fae3413e8a0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-03-06T13:49:21.503 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.487+0000 7fae38d57700 1 --2- 172.21.15.86:0/3243000203 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7fae340bd3f0 0x7fae3413e8a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:21.504 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.487+0000 7fae38d57700 1 -- 172.21.15.86:0/3243000203 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae300094a0 con 0x7fae34145510 2023-03-06T13:49:21.504 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.487+0000 7fa738afd700 1 -- 172.21.15.86:0/146585678 --> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7180052e0 con 0x7fa73413f820 2023-03-06T13:49:21.504 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.487+0000 7fae38d57700 1 --2- 172.21.15.86:0/3243000203 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fae34145510 0x7fae34146080 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fae300090b0 tx=0x7fae30004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T13:49:21.505 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.488+0000 7fae29ffb700 1 -- 172.21.15.86:0/3243000203 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae3001c070 con 0x7fae34145510 2023-03-06T13:49:21.505 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.488+0000 7fae29ffb700 1 -- 172.21.15.86:0/3243000203 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae30004550 con 0x7fae34145510 2023-03-06T13:49:21.505 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.488+0000 7fae29ffb700 1 -- 172.21.15.86:0/3243000203 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae300038c0 con 0x7fae34145510 2023-03-06T13:49:21.505 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.488+0000 7fae3b7bc700 1 -- 172.21.15.86:0/3243000203 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae340bbe50 con 0x7fae34145510 2023-03-06T13:49:21.505 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.488+0000 7fae3b7bc700 1 -- 172.21.15.86:0/3243000203 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae340bbb70 con 0x7fae34145510 2023-03-06T13:49:21.505 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.489+0000 7fae3b7bc700 1 -- 172.21.15.86:0/3243000203 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae340bc130 con 0x7fae34145510 2023-03-06T13:49:21.506 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.492+0000 7fae29ffb700 1 -- 172.21.15.86:0/3243000203 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fae30020070 con 0x7fae34145510 2023-03-06T13:49:21.506 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.492+0000 7fae29ffb700 1 --2- 172.21.15.86:0/3243000203 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7fae18068320 0x7fae1806a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:21.506 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.492+0000 7fae29ffb700 1 -- 172.21.15.86:0/3243000203 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fae30087570 con 0x7fae34145510 2023-03-06T13:49:21.506 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.493+0000 7fa722ffd700 1 -- 172.21.15.86:0/146585678 <== mon.2 v2:172.21.15.202:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fa72c0572a0 con 0x7fa73413f820 2023-03-06T13:49:21.507 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.499+0000 7fae29ffb700 1 -- 172.21.15.86:0/3243000203 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fae30053d60 con 0x7fae34145510 2023-03-06T13:49:21.507 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.500+0000 7fae39558700 1 --2- 172.21.15.86:0/3243000203 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7fae18068320 0x7fae1806a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:21.507 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.501+0000 7fae39558700 1 --2- 172.21.15.86:0/3243000203 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7fae18068320 0x7fae1806a7d0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fae2400b850 tx=0x7fae24008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T13:49:21.538 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.534+0000 7fa70a2f8700 1 Processor -- start 2023-03-06T13:49:21.538 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.534+0000 7fa70a2f8700 1 -- start start 2023-03-06T13:49:21.538 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.535+0000 7fa70a2f8700 1 --2- >> v2:172.21.15.202:3300/0 conn(0x7fa7040c19d0 0x7fa7040b8c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:21.539 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.535+0000 7fa70a2f8700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fa7040bc1f0 0x7fa70406c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:21.539 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.535+0000 7fa70a2f8700 1 --2- >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fa70406cde0 0x7fa70406d240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:21.539 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.535+0000 7fa70a2f8700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7040bc9d0 con 0x7fa7040bc1f0 2023-03-06T13:49:21.539 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.535+0000 7fa70a2f8700 1 -- --> v2:172.21.15.202:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7040bc6f0 con 0x7fa7040c19d0 2023-03-06T13:49:21.539 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.535+0000 7fa70a2f8700 1 -- --> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7040b6920 con 0x7fa70406cde0 2023-03-06T13:49:21.539 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.536+0000 7fa703fff700 1 --2- >> v2:172.21.15.202:3300/0 conn(0x7fa7040c19d0 0x7fa7040b8c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:21.539 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.536+0000 7fa703fff700 1 --2- >> v2:172.21.15.202:3300/0 conn(0x7fa7040c19d0 0x7fa7040b8c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.202:3300/0 says I am v2:172.21.15.86:44530/0 (socket says 172.21.15.86:44530) 2023-03-06T13:49:21.539 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.536+0000 7fa703fff700 1 -- 172.21.15.86:0/1095249715 learned_addr learned my addr 172.21.15.86:0/1095249715 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-03-06T13:49:21.540 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.536+0000 7fa703fff700 1 -- 172.21.15.86:0/1095249715 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fa70406cde0 msgr2=0x7fa70406d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T13:49:21.540 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.536+0000 7fa703fff700 1 --2- 172.21.15.86:0/1095249715 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fa70406cde0 0x7fa70406d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:21.540 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.536+0000 7fa703fff700 1 -- 172.21.15.86:0/1095249715 >> v2:172.21.15.86:3300/0 conn(0x7fa7040bc1f0 msgr2=0x7fa70406c8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T13:49:21.540 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.536+0000 7fa703fff700 1 --2- 172.21.15.86:0/1095249715 >> v2:172.21.15.86:3300/0 conn(0x7fa7040bc1f0 0x7fa70406c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:21.540 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.536+0000 7fa703fff700 1 -- 172.21.15.86:0/1095249715 --> v2:172.21.15.202:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7040b6c00 con 0x7fa7040c19d0 2023-03-06T13:49:21.540 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.536+0000 7fa703fff700 1 --2- 172.21.15.86:0/1095249715 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7fa7040c19d0 0x7fa7040b8c00 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fa70406f2b0 tx=0x7fa6f8008bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=23ac4479f6d6e128 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T13:49:21.541 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.537+0000 7f0c3d103700 1 Processor -- start 2023-03-06T13:49:21.541 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.537+0000 7f0c3d103700 1 -- start start 2023-03-06T13:49:21.541 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.537+0000 7fa702ffd700 1 -- 172.21.15.86:0/1095249715 <== mon.1 v2:172.21.15.202:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6f8013a20 con 0x7fa7040c19d0 2023-03-06T13:49:21.542 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.538+0000 7fd3b63fb700 1 Processor -- start 2023-03-06T13:49:21.542 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.538+0000 7fa702ffd700 1 -- 172.21.15.86:0/1095249715 <== mon.1 v2:172.21.15.202:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6f8013b80 con 0x7fa7040c19d0 2023-03-06T13:49:21.543 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.538+0000 7fa702ffd700 1 -- 172.21.15.86:0/1095249715 <== mon.1 v2:172.21.15.202:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6f801b400 con 0x7fa7040c19d0 2023-03-06T13:49:21.543 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.539+0000 7fa70a2f8700 1 -- 172.21.15.86:0/1095249715 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7fa7040c19d0 msgr2=0x7fa7040b8c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:21.543 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.539+0000 7fa70a2f8700 1 --2- 172.21.15.86:0/1095249715 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7fa7040c19d0 0x7fa7040b8c00 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fa70406f2b0 tx=0x7fa6f8008bd0 comp rx=0 tx=0).stop 2023-03-06T13:49:21.543 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.539+0000 7fa70a2f8700 1 -- 172.21.15.86:0/1095249715 shutdown_connections 2023-03-06T13:49:21.543 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.539+0000 7fa70a2f8700 1 --2- 172.21.15.86:0/1095249715 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7fa7040c19d0 0x7fa7040b8c00 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:21.543 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.539+0000 7fa70a2f8700 1 --2- 172.21.15.86:0/1095249715 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fa70406cde0 0x7fa70406d240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:21.543 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.539+0000 7fa70a2f8700 1 --2- 172.21.15.86:0/1095249715 >> v2:172.21.15.86:3300/0 conn(0x7fa7040bc1f0 0x7fa70406c8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:21.544 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.539+0000 7fa70a2f8700 1 -- 172.21.15.86:0/1095249715 >> 172.21.15.86:0/1095249715 conn(0x7fa70406afc0 msgr2=0x7fa7040c1050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T13:49:21.544 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.538+0000 7fd3b63fb700 1 -- start start 2023-03-06T13:49:21.544 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.539+0000 7fd3b63fb700 1 --2- >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fd3b0145510 0x7fd3b014f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:21.544 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.539+0000 7fd3b63fb700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fd3b00b5fd0 0x7fd3b00bc930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:21.544 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.539+0000 7fd3b63fb700 1 -- --> v1:172.21.15.202:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3b00bc4a0 con 0x7fd3b00bd3f0 2023-03-06T13:49:21.544 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.539+0000 7fd3b63fb700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3b00b7e40 con 0x7fd3b00b5fd0 2023-03-06T13:49:21.545 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.539+0000 7fd3b63fb700 1 -- --> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3b014f6d0 con 0x7fd3b0145510 2023-03-06T13:49:21.545 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.539+0000 7fa70a2f8700 1 -- 172.21.15.86:0/1095249715 shutdown_connections 2023-03-06T13:49:21.545 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.538+0000 7f0c3d103700 1 --2- >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f0c380c2270 0x7f0c380bc2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:21.545 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.538+0000 7f0c3d103700 1 --2- >> v2:172.21.15.202:3300/0 conn(0x7f0c3806b980 0x7f0c381579f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:21.546 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.538+0000 7f0c3d103700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c380c0c40 con 0x7f0c38065fb0 2023-03-06T13:49:21.546 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.538+0000 7f0c3d103700 1 -- --> v2:172.21.15.202:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c380c03c0 con 0x7f0c3806b980 2023-03-06T13:49:21.546 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.538+0000 7f0c3d103700 1 -- --> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c3806e460 con 0x7f0c380c2270 2023-03-06T13:49:21.546 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.538+0000 7f0c36d9d700 1 --2- >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f0c380c2270 0x7f0c380bc2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:21.546 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.538+0000 7f0c36d9d700 1 --2- >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f0c380c2270 0x7f0c380bc2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.202:3301/0 says I am v2:172.21.15.86:50700/0 (socket says 172.21.15.86:50700) 2023-03-06T13:49:21.546 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.538+0000 7f0c36d9d700 1 -- 172.21.15.86:0/2804528389 learned_addr learned my addr 172.21.15.86:0/2804528389 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-03-06T13:49:21.546 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.538+0000 7f0c3759e700 1 --2- 172.21.15.86:0/2804528389 >> v2:172.21.15.202:3300/0 conn(0x7f0c3806b980 0x7f0c381579f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:21.547 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.538+0000 7f0c36d9d700 1 -- 172.21.15.86:0/2804528389 >> v2:172.21.15.202:3300/0 conn(0x7f0c3806b980 msgr2=0x7f0c381579f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T13:49:21.547 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.538+0000 7f0c36d9d700 1 --2- 172.21.15.86:0/2804528389 >> v2:172.21.15.202:3300/0 conn(0x7f0c3806b980 0x7f0c381579f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:21.547 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.538+0000 7f0c36d9d700 1 -- 172.21.15.86:0/2804528389 >> v1:172.21.15.86:6789/0 conn(0x7f0c38065fb0 legacy=0x7f0c38150e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:21.547 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.538+0000 7f0c36d9d700 1 -- 172.21.15.86:0/2804528389 --> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c380bf890 con 0x7f0c380c2270 2023-03-06T13:49:21.547 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.539+0000 7f0c36d9d700 1 --2- 172.21.15.86:0/2804528389 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f0c380c2270 0x7f0c380bc2e0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f0c28014500 tx=0x7f0c28014810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=252bd5292cc04247 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T13:49:21.548 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.540+0000 7efdf49ed700 1 Processor -- start 2023-03-06T13:49:21.548 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.539+0000 7fd3af7fe700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fd3b00b5fd0 0x7fd3b00bc930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:21.548 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.539+0000 7fd3af7fe700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fd3b00b5fd0 0x7fd3b00bc930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:39012/0 (socket says 172.21.15.86:39012) 2023-03-06T13:49:21.549 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.539+0000 7fd3af7fe700 1 -- 172.21.15.86:0/1126238320 learned_addr learned my addr 172.21.15.86:0/1126238320 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-03-06T13:49:21.549 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.540+0000 7efdf49ed700 1 -- start start 2023-03-06T13:49:21.549 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.540+0000 7fd3af7fe700 1 -- 172.21.15.86:0/1126238320 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fd3b0145510 msgr2=0x7fd3b014f0f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-03-06T13:49:21.550 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.540+0000 7fd3af7fe700 1 --2- 172.21.15.86:0/1126238320 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fd3b0145510 0x7fd3b014f0f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:21.550 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.540+0000 7fd3af7fe700 1 -- 172.21.15.86:0/1126238320 >> v1:172.21.15.202:6789/0 conn(0x7fd3b00bd3f0 legacy=0x7fd3b006c8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T13:49:21.550 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.540+0000 7fd3af7fe700 1 -- 172.21.15.86:0/1126238320 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3b01458e0 con 0x7fd3b00b5fd0 2023-03-06T13:49:21.550 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.540+0000 7fd3af7fe700 1 --2- 172.21.15.86:0/1126238320 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd3b00b5fd0 0x7fd3b00bc930 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fd3a0007070 tx=0x7fd3a0007380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b940038dce557c42 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T13:49:21.550 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.540+0000 7fd3aeffd700 1 -- 172.21.15.86:0/1126238320 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3a0007cc0 con 0x7fd3b00b5fd0 2023-03-06T13:49:21.551 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.540+0000 7fd3aeffd700 1 -- 172.21.15.86:0/1126238320 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3a0007e20 con 0x7fd3b00b5fd0 2023-03-06T13:49:21.551 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.540+0000 7fd3aeffd700 1 -- 172.21.15.86:0/1126238320 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3a0004250 con 0x7fd3b00b5fd0 2023-03-06T13:49:21.551 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.539+0000 7fa70a2f8700 1 -- 172.21.15.86:0/1095249715 wait complete. 2023-03-06T13:49:21.551 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.541+0000 7fa70a2f8700 1 Processor -- start 2023-03-06T13:49:21.552 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.541+0000 7efdf49ed700 1 --2- >> v2:172.21.15.202:3300/0 conn(0x7efdf00c1e30 0x7efdf0146f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:21.553 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.541+0000 7efdf49ed700 1 --2- >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7efdf00703f0 0x7efdf014d530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:21.553 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.541+0000 7efdf49ed700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7efdf00bd9a0 0x7efdf014da70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:21.553 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.541+0000 7efdf49ed700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efdf00711f0 con 0x7efdf00bd9a0 2023-03-06T13:49:21.554 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.541+0000 7efdf49ed700 1 -- --> v2:172.21.15.202:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efdf0072530 con 0x7efdf00c1e30 2023-03-06T13:49:21.554 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.541+0000 7efdf49ed700 1 -- --> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdf006f9e0 con 0x7efdf00703f0 2023-03-06T13:49:21.555 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.541+0000 7fa70a2f8700 1 -- start start 2023-03-06T13:49:21.555 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.541+0000 7efdee59c700 1 --2- >> v2:172.21.15.202:3300/0 conn(0x7efdf00c1e30 0x7efdf0146f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:21.556 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.541+0000 7efdeed9d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7efdf00bd9a0 0x7efdf014da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:21.556 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.541+0000 7efdee59c700 1 --2- >> v2:172.21.15.202:3300/0 conn(0x7efdf00c1e30 0x7efdf0146f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.202:3300/0 says I am v2:172.21.15.86:44546/0 (socket says 172.21.15.86:44546) 2023-03-06T13:49:21.556 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.541+0000 7efdeed9d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7efdf00bd9a0 0x7efdf014da70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:39018/0 (socket says 172.21.15.86:39018) 2023-03-06T13:49:21.556 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.541+0000 7efdee59c700 1 -- 172.21.15.86:0/4178632436 learned_addr learned my addr 172.21.15.86:0/4178632436 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-03-06T13:49:21.557 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.541+0000 7fd3b63fb700 1 -- 172.21.15.86:0/1126238320 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd3b00b5fd0 msgr2=0x7fd3b00bc930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:21.557 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.541+0000 7fd3b63fb700 1 --2- 172.21.15.86:0/1126238320 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd3b00b5fd0 0x7fd3b00bc930 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fd3a0007070 tx=0x7fd3a0007380 comp rx=0 tx=0).stop 2023-03-06T13:49:21.558 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.541+0000 7fd3b63fb700 1 -- 172.21.15.86:0/1126238320 shutdown_connections 2023-03-06T13:49:21.558 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.541+0000 7fd3b63fb700 1 --2- 172.21.15.86:0/1126238320 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fd3b0145510 0x7fd3b014f0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:21.558 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.541+0000 7fd3b63fb700 1 --2- 172.21.15.86:0/1126238320 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd3b00b5fd0 0x7fd3b00bc930 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:21.559 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.541+0000 7fd3b63fb700 1 -- 172.21.15.86:0/1126238320 >> 172.21.15.86:0/1126238320 conn(0x7fd3b006afc0 msgr2=0x7fd3b00c1050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T13:49:21.559 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.542+0000 7efdeed9d700 1 -- 172.21.15.86:0/4178632436 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7efdf00703f0 msgr2=0x7efdf014d530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T13:49:21.560 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.542+0000 7efdeed9d700 1 --2- 172.21.15.86:0/4178632436 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7efdf00703f0 0x7efdf014d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:21.560 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.542+0000 7efdeed9d700 1 -- 172.21.15.86:0/4178632436 >> v2:172.21.15.202:3300/0 conn(0x7efdf00c1e30 msgr2=0x7efdf0146f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T13:49:21.560 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.542+0000 7efdeed9d700 1 --2- 172.21.15.86:0/4178632436 >> v2:172.21.15.202:3300/0 conn(0x7efdf00c1e30 0x7efdf0146f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:21.561 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.542+0000 7efdeed9d700 1 -- 172.21.15.86:0/4178632436 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdf014d030 con 0x7efdf00bd9a0 2023-03-06T13:49:21.561 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.542+0000 7efdee59c700 1 --2- 172.21.15.86:0/4178632436 >> v2:172.21.15.202:3300/0 conn(0x7efdf00c1e30 0x7efdf0146f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-06T13:49:21.561 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.542+0000 7efdeed9d700 1 --2- 172.21.15.86:0/4178632436 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efdf00bd9a0 0x7efdf014da70 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7efdf00bde90 tx=0x7efde800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cbb04f4a1993d5b server_cookie=0 in_seq=0 out_seq=0 2023-03-06T13:49:21.564 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.542+0000 7fa70a2f8700 1 --2- >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fa70406cde0 0x7fa704072190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:21.564 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.542+0000 7fa70a2f8700 1 --2- >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7fa7040bc1f0 0x7fa70406f760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:21.564 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.542+0000 7fa70a2f8700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa7040c19d0 0x7fa7041e8600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:21.564 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.542+0000 7fa70a2f8700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa704071430 con 0x7fa7040c19d0 2023-03-06T13:49:21.565 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.542+0000 7fa70a2f8700 1 -- --> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7041e4b10 con 0x7fa7040bc1f0 2023-03-06T13:49:21.565 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.542+0000 7fa70a2f8700 1 -- --> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7041f1d60 con 0x7fa70406cde0 2023-03-06T13:49:21.565 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.542+0000 7fa708895700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa7040c19d0 0x7fa7041e8600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:21.565 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.542+0000 7fa708895700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa7040c19d0 0x7fa7041e8600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:39022/0 (socket says 172.21.15.86:39022) 2023-03-06T13:49:21.565 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.542+0000 7fa708895700 1 -- 172.21.15.86:0/586648492 learned_addr learned my addr 172.21.15.86:0/586648492 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-03-06T13:49:21.565 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.542+0000 7fa703fff700 1 --2- 172.21.15.86:0/586648492 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fa70406cde0 0x7fa704072190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:21.565 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.542+0000 7fa7037fe700 1 --2- 172.21.15.86:0/586648492 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7fa7040bc1f0 0x7fa70406f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:21.566 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.543+0000 7fa708895700 1 -- 172.21.15.86:0/586648492 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fa70406cde0 msgr2=0x7fa704072190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:21.566 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.543+0000 7fa708895700 1 --2- 172.21.15.86:0/586648492 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fa70406cde0 0x7fa704072190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:21.566 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.543+0000 7fa708895700 1 -- 172.21.15.86:0/586648492 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7fa7040bc1f0 msgr2=0x7fa70406f760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:21.566 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.543+0000 7fa708895700 1 --2- 172.21.15.86:0/586648492 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7fa7040bc1f0 0x7fa70406f760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:21.566 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.543+0000 7fa708895700 1 -- 172.21.15.86:0/586648492 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6f8008550 con 0x7fa7040c19d0 2023-03-06T13:49:21.566 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.543+0000 7fa708895700 1 --2- 172.21.15.86:0/586648492 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa7040c19d0 0x7fa7041e8600 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fa6fc00b970 tx=0x7fa6fc00bc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T13:49:21.566 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.543+0000 7fa700ff9700 1 -- 172.21.15.86:0/586648492 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6fc00c930 con 0x7fa7040c19d0 2023-03-06T13:49:21.567 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.543+0000 7fa70a2f8700 1 -- 172.21.15.86:0/586648492 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7040b8660 con 0x7fa7040c19d0 2023-03-06T13:49:21.567 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.543+0000 7fa70a2f8700 1 -- 172.21.15.86:0/586648492 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7040b6ee0 con 0x7fa7040c19d0 2023-03-06T13:49:21.567 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.543+0000 7fa700ff9700 1 -- 172.21.15.86:0/586648492 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6fc00ca90 con 0x7fa7040c19d0 2023-03-06T13:49:21.567 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.543+0000 7fa700ff9700 1 -- 172.21.15.86:0/586648492 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6fc00ce00 con 0x7fa7040c19d0 2023-03-06T13:49:21.567 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.544+0000 7fa70a2f8700 1 -- 172.21.15.86:0/586648492 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7040bd7e0 con 0x7fa7040c19d0 2023-03-06T13:49:21.567 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.544+0000 7fa700ff9700 1 -- 172.21.15.86:0/586648492 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fa6fc01b030 con 0x7fa7040c19d0 2023-03-06T13:49:21.567 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.545+0000 7fa700ff9700 1 --2- 172.21.15.86:0/586648492 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7fa6ec0684a0 0x7fa6ec06a950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:21.567 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.545+0000 7fa700ff9700 1 -- 172.21.15.86:0/586648492 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa6fc006e40 con 0x7fa7040c19d0 2023-03-06T13:49:21.568 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.545+0000 7fa703fff700 1 --2- 172.21.15.86:0/586648492 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7fa6ec0684a0 0x7fa6ec06a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:21.568 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.545+0000 7fa703fff700 1 --2- 172.21.15.86:0/586648492 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7fa6ec0684a0 0x7fa6ec06a950 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fa6f8008c10 tx=0x7fa6f800c000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T13:49:21.568 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.546+0000 7efded59a700 1 -- 172.21.15.86:0/4178632436 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efde800e070 con 0x7efdf00bd9a0 2023-03-06T13:49:21.568 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.546+0000 7efded59a700 1 -- 172.21.15.86:0/4178632436 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efde800bb20 con 0x7efdf00bd9a0 2023-03-06T13:49:21.568 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.546+0000 7efded59a700 1 -- 172.21.15.86:0/4178632436 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efde8012430 con 0x7efdf00bd9a0 2023-03-06T13:49:21.569 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.547+0000 7fd3b63fb700 1 -- 172.21.15.86:0/1126238320 shutdown_connections 2023-03-06T13:49:21.569 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.547+0000 7fd3b63fb700 1 -- 172.21.15.86:0/1126238320 wait complete. 2023-03-06T13:49:21.569 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.547+0000 7f0c3659c700 1 -- 172.21.15.86:0/2804528389 <== mon.2 v2:172.21.15.202:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c28005e30 con 0x7f0c380c2270 2023-03-06T13:49:21.570 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.547+0000 7f0c3659c700 1 -- 172.21.15.86:0/2804528389 <== mon.2 v2:172.21.15.202:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c2800f0d0 con 0x7f0c380c2270 2023-03-06T13:49:21.570 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.547+0000 7f0c3659c700 1 -- 172.21.15.86:0/2804528389 <== mon.2 v2:172.21.15.202:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c28015640 con 0x7f0c380c2270 2023-03-06T13:49:21.570 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.548+0000 7f0c3d103700 1 -- 172.21.15.86:0/2804528389 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f0c380c2270 msgr2=0x7f0c380bc2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:21.570 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.548+0000 7f0c3d103700 1 --2- 172.21.15.86:0/2804528389 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f0c380c2270 0x7f0c380bc2e0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f0c28014500 tx=0x7f0c28014810 comp rx=0 tx=0).stop 2023-03-06T13:49:21.570 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.548+0000 7f0c3d103700 1 -- 172.21.15.86:0/2804528389 shutdown_connections 2023-03-06T13:49:21.570 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.548+0000 7f0c3d103700 1 --2- 172.21.15.86:0/2804528389 >> v2:172.21.15.202:3300/0 conn(0x7f0c3806b980 0x7f0c381579f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:21.570 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.548+0000 7f0c3d103700 1 --2- 172.21.15.86:0/2804528389 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f0c380c2270 0x7f0c380bc2e0 secure :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f0c28014500 tx=0x7f0c28014810 comp rx=0 tx=0).stop 2023-03-06T13:49:21.571 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.548+0000 7f0c3d103700 1 -- 172.21.15.86:0/2804528389 >> 172.21.15.86:0/2804528389 conn(0x7f0c380a4180 msgr2=0x7f0c380c18f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T13:49:21.571 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.549+0000 7efdf49ed700 1 -- 172.21.15.86:0/4178632436 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efdf00bd9a0 msgr2=0x7efdf014da70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:21.571 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.549+0000 7efdf49ed700 1 --2- 172.21.15.86:0/4178632436 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efdf00bd9a0 0x7efdf014da70 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7efdf00bde90 tx=0x7efde800b330 comp rx=0 tx=0).stop 2023-03-06T13:49:21.571 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.549+0000 7fd3b63fb700 1 Processor -- start 2023-03-06T13:49:21.572 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.550+0000 7efdf49ed700 1 -- 172.21.15.86:0/4178632436 shutdown_connections 2023-03-06T13:49:21.572 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.550+0000 7efdf49ed700 1 --2- 172.21.15.86:0/4178632436 >> v2:172.21.15.202:3300/0 conn(0x7efdf00c1e30 0x7efdf0146f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:21.572 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.550+0000 7efdf49ed700 1 --2- 172.21.15.86:0/4178632436 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efdf00bd9a0 0x7efdf014da70 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:21.572 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.550+0000 7efdf49ed700 1 --2- 172.21.15.86:0/4178632436 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7efdf00703f0 0x7efdf014d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:21.572 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.550+0000 7efdf49ed700 1 -- 172.21.15.86:0/4178632436 >> 172.21.15.86:0/4178632436 conn(0x7efdf006c6c0 msgr2=0x7efdf00c14b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T13:49:21.573 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.549+0000 7fd3b63fb700 1 -- start start 2023-03-06T13:49:21.573 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.550+0000 7fd3b63fb700 1 --2- >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7fd3b00bd3f0 0x7fd3b014d590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:21.573 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.550+0000 7fd3b63fb700 1 --2- >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fd3b0145510 0x7fd3b01f5030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:21.573 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.550+0000 7fd3b63fb700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd3b00c09a0 0x7fd3b01f5570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:21.573 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.550+0000 7fd3b63fb700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3b0146210 con 0x7fd3b00c09a0 2023-03-06T13:49:21.573 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.550+0000 7fd3b63fb700 1 -- --> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3b014dad0 con 0x7fd3b00bd3f0 2023-03-06T13:49:21.574 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.550+0000 7fd3b63fb700 1 -- --> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3b0146460 con 0x7fd3b0145510 2023-03-06T13:49:21.574 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.549+0000 7f0c3d103700 1 -- 172.21.15.86:0/2804528389 shutdown_connections 2023-03-06T13:49:21.574 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.549+0000 7f0c3d103700 1 -- 172.21.15.86:0/2804528389 wait complete. 2023-03-06T13:49:21.575 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.550+0000 7fd3b4998700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd3b00c09a0 0x7fd3b01f5570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:21.575 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.550+0000 7fd3b4998700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd3b00c09a0 0x7fd3b01f5570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:39032/0 (socket says 172.21.15.86:39032) 2023-03-06T13:49:21.575 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.550+0000 7fd3b4998700 1 -- 172.21.15.86:0/4072461396 learned_addr learned my addr 172.21.15.86:0/4072461396 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-03-06T13:49:21.575 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.550+0000 7fd3af7fe700 1 --2- 172.21.15.86:0/4072461396 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fd3b0145510 0x7fd3b01f5030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:21.575 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.550+0000 7f646db2d700 1 Processor -- start 2023-03-06T13:49:21.576 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.551+0000 7f646db2d700 1 -- start start 2023-03-06T13:49:21.576 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.551+0000 7fd3b4998700 1 -- 172.21.15.86:0/4072461396 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fd3b0145510 msgr2=0x7fd3b01f5030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:21.576 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.551+0000 7fd3b4998700 1 --2- 172.21.15.86:0/4072461396 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fd3b0145510 0x7fd3b01f5030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:21.576 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.551+0000 7fd3b4998700 1 -- 172.21.15.86:0/4072461396 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7fd3b00bd3f0 msgr2=0x7fd3b014d590 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-03-06T13:49:21.576 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.551+0000 7fd3b4998700 1 --2- 172.21.15.86:0/4072461396 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7fd3b00bd3f0 0x7fd3b014d590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:21.576 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.551+0000 7fd3b4998700 1 -- 172.21.15.86:0/4072461396 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3a0009e70 con 0x7fd3b00c09a0 2023-03-06T13:49:21.577 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.551+0000 7f0c3d103700 1 Processor -- start 2023-03-06T13:49:21.577 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.551+0000 7fd3b4998700 1 --2- 172.21.15.86:0/4072461396 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd3b00c09a0 0x7fd3b01f5570 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fd3a400c4c0 tx=0x7fd3a4001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T13:49:21.578 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.552+0000 7f646db2d700 1 --2- >> v2:172.21.15.202:3300/0 conn(0x7f646806d070 0x7f646806d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:21.578 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.552+0000 7f646db2d700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6468154020 con 0x7f64680b7770 2023-03-06T13:49:21.578 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.552+0000 7f646db2d700 1 -- --> v1:172.21.15.202:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f646806da10 con 0x7f646815bd70 2023-03-06T13:49:21.578 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.552+0000 7f646db2d700 1 -- --> v2:172.21.15.202:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64680b6bc0 con 0x7f646806d070 2023-03-06T13:49:21.578 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.552+0000 7f64677fe700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f64680b7770 0x7f64680b7b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:49184/0 (socket says 172.21.15.86:49184) 2023-03-06T13:49:21.578 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.552+0000 7f64677fe700 1 -- 172.21.15.86:0/301396628 learned_addr learned my addr 172.21.15.86:0/301396628 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-03-06T13:49:21.579 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.552+0000 7f6466ffd700 1 --2- 172.21.15.86:0/301396628 >> v2:172.21.15.202:3300/0 conn(0x7f646806d070 0x7f646806d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:21.579 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.553+0000 7f6466ffd700 1 -- 172.21.15.86:0/301396628 >> v1:172.21.15.202:6789/0 conn(0x7f646815bd70 legacy=0x7f646815e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:21.579 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.553+0000 7f6466ffd700 1 -- 172.21.15.86:0/301396628 >> v1:172.21.15.86:6789/0 conn(0x7f64680b7770 legacy=0x7f64680b7b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:21.579 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.553+0000 7f6466ffd700 1 -- 172.21.15.86:0/301396628 --> v2:172.21.15.202:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f646806c890 con 0x7f646806d070 2023-03-06T13:49:21.579 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.552+0000 7fa700ff9700 1 -- 172.21.15.86:0/586648492 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fa6fc04d5e0 con 0x7fa7040c19d0 2023-03-06T13:49:21.580 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.551+0000 7f0c3d103700 1 -- start start 2023-03-06T13:49:21.580 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.552+0000 7f0c3d103700 1 --2- >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f0c38065fb0 0x7f0c380a4840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:21.580 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.552+0000 7f0c3d103700 1 --2- >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f0c3806b980 0x7f0c380a2570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:21.580 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.552+0000 7f0c3d103700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0c380a6660 0x7f0c38148fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:21.580 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.552+0000 7f0c3d103700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c380a2ab0 con 0x7f0c380a6660 2023-03-06T13:49:21.580 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.552+0000 7f0c3d103700 1 -- --> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c381494f0 con 0x7f0c38065fb0 2023-03-06T13:49:21.580 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.552+0000 7f0c3d103700 1 -- --> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c381e4680 con 0x7f0c3806b980 2023-03-06T13:49:21.581 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.553+0000 7f0c3759e700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0c380a6660 0x7f0c38148fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:21.581 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.553+0000 7f0c3759e700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0c380a6660 0x7f0c38148fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:39042/0 (socket says 172.21.15.86:39042) 2023-03-06T13:49:21.581 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.553+0000 7f0c3759e700 1 -- 172.21.15.86:0/1554475592 learned_addr learned my addr 172.21.15.86:0/1554475592 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-03-06T13:49:21.581 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.553+0000 7f0c2e59c700 1 --2- 172.21.15.86:0/1554475592 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f0c3806b980 0x7f0c380a2570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:21.581 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.553+0000 7f0c36d9d700 1 --2- 172.21.15.86:0/1554475592 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f0c38065fb0 0x7f0c380a4840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:21.581 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.553+0000 7f0c2e59c700 1 -- 172.21.15.86:0/1554475592 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f0c38065fb0 msgr2=0x7f0c380a4840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:21.581 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.553+0000 7f0c2e59c700 1 --2- 172.21.15.86:0/1554475592 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f0c38065fb0 0x7f0c380a4840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:21.582 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.553+0000 7f0c2e59c700 1 -- 172.21.15.86:0/1554475592 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0c380a6660 msgr2=0x7f0c38148fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:21.582 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.553+0000 7f0c2e59c700 1 --2- 172.21.15.86:0/1554475592 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0c380a6660 0x7f0c38148fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:21.582 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.553+0000 7f0c2e59c700 1 -- 172.21.15.86:0/1554475592 --> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c2800fd90 con 0x7f0c3806b980 2023-03-06T13:49:21.582 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.551+0000 7efdf49ed700 1 -- 172.21.15.86:0/4178632436 shutdown_connections 2023-03-06T13:49:21.582 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.551+0000 7efdf49ed700 1 -- 172.21.15.86:0/4178632436 wait complete. 2023-03-06T13:49:21.582 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.552+0000 7efdf49ed700 1 Processor -- start 2023-03-06T13:49:21.583 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.553+0000 7efdf49ed700 1 -- start start 2023-03-06T13:49:21.583 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.552+0000 7fd3acff9700 1 -- 172.21.15.86:0/4072461396 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3a40054e0 con 0x7fd3b00c09a0 2023-03-06T13:49:21.583 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.552+0000 7fd3acff9700 1 -- 172.21.15.86:0/4072461396 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3a4003680 con 0x7fd3b00c09a0 2023-03-06T13:49:21.583 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.552+0000 7fd3b63fb700 1 -- 172.21.15.86:0/4072461396 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3b00bbe50 con 0x7fd3b00c09a0 2023-03-06T13:49:21.583 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.552+0000 7fd3acff9700 1 -- 172.21.15.86:0/4072461396 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3a4003a30 con 0x7fd3b00c09a0 2023-03-06T13:49:21.583 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.552+0000 7fd3b63fb700 1 -- 172.21.15.86:0/4072461396 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3b00bbb70 con 0x7fd3b00c09a0 2023-03-06T13:49:21.584 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.554+0000 7f0c2e59c700 1 --2- 172.21.15.86:0/1554475592 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f0c3806b980 0x7f0c380a2570 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f0c2000c400 tx=0x7f0c2000c710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T13:49:21.584 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.553+0000 7efdf49ed700 1 --2- >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7efdf00703f0 0x7efdf0145c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:21.584 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.554+0000 7efdf49ed700 1 --2- >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7efdf00bd9a0 0x7efdf01e4330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:21.585 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.554+0000 7efdf49ed700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efdf00c1e30 0x7efdf0140490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:21.585 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.554+0000 7efdf49ed700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdf00a47c0 con 0x7efdf00c1e30 2023-03-06T13:49:21.585 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.554+0000 7efdf49ed700 1 -- --> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdf0145240 con 0x7efdf00703f0 2023-03-06T13:49:21.585 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.554+0000 7efdf49ed700 1 -- --> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdf0145800 con 0x7efdf00bd9a0 2023-03-06T13:49:21.585 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.554+0000 7fd3b63fb700 1 -- 172.21.15.86:0/4072461396 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3b00bc130 con 0x7fd3b00c09a0 2023-03-06T13:49:21.586 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.554+0000 7efdee59c700 1 --2- >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7efdf00703f0 0x7efdf0145c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:21.586 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.554+0000 7efdee59c700 1 --2- >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7efdf00703f0 0x7efdf0145c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.202:3300/0 says I am v2:172.21.15.86:44578/0 (socket says 172.21.15.86:44578) 2023-03-06T13:49:21.586 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.554+0000 7efdeed9d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efdf00c1e30 0x7efdf0140490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:21.586 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.554+0000 7efdee59c700 1 -- 172.21.15.86:0/2056288743 learned_addr learned my addr 172.21.15.86:0/2056288743 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-03-06T13:49:21.587 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.554+0000 7f6466ffd700 1 --2- 172.21.15.86:0/301396628 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f646806d070 0x7f646806d4d0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f645c009840 tx=0x7f645c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4c85cf1e17ab8dc3 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T13:49:21.587 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.554+0000 7f0c2ffff700 1 -- 172.21.15.86:0/1554475592 <== mon.2 v2:172.21.15.202:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c200052d0 con 0x7f0c3806b980 2023-03-06T13:49:21.587 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.554+0000 7f0c2ffff700 1 -- 172.21.15.86:0/1554475592 <== mon.2 v2:172.21.15.202:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c20005430 con 0x7f0c3806b980 2023-03-06T13:49:21.587 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.554+0000 7f0c2ffff700 1 -- 172.21.15.86:0/1554475592 <== mon.2 v2:172.21.15.202:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c20006a80 con 0x7f0c3806b980 2023-03-06T13:49:21.587 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.554+0000 7f64667fc700 1 -- 172.21.15.86:0/301396628 <== mon.1 v2:172.21.15.202:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f645c011830 con 0x7f646806d070 2023-03-06T13:49:21.588 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.554+0000 7f64667fc700 1 -- 172.21.15.86:0/301396628 <== mon.1 v2:172.21.15.202:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f645c011990 con 0x7f646806d070 2023-03-06T13:49:21.588 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.554+0000 7f64667fc700 1 -- 172.21.15.86:0/301396628 <== mon.1 v2:172.21.15.202:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f645c011d20 con 0x7f646806d070 2023-03-06T13:49:21.588 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.554+0000 7efdeed9d700 1 -- 172.21.15.86:0/2056288743 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7efdf00bd9a0 msgr2=0x7efdf01e4330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:21.588 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.554+0000 7efdeed9d700 1 --2- 172.21.15.86:0/2056288743 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7efdf00bd9a0 0x7efdf01e4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:21.589 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.554+0000 7efdeed9d700 1 -- 172.21.15.86:0/2056288743 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7efdf00703f0 msgr2=0x7efdf0145c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:21.589 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.554+0000 7efdeed9d700 1 --2- 172.21.15.86:0/2056288743 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7efdf00703f0 0x7efdf0145c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:21.589 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.554+0000 7efdeed9d700 1 -- 172.21.15.86:0/2056288743 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efde000d9f0 con 0x7efdf00c1e30 2023-03-06T13:49:21.589 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.555+0000 7efdeed9d700 1 --2- 172.21.15.86:0/2056288743 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efdf00c1e30 0x7efdf0140490 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7efde8016000 tx=0x7efde8004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T13:49:21.590 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.555+0000 7f646db2d700 1 -- 172.21.15.86:0/301396628 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f646806d070 msgr2=0x7f646806d4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:21.590 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.555+0000 7f646db2d700 1 --2- 172.21.15.86:0/301396628 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f646806d070 0x7f646806d4d0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f645c009840 tx=0x7f645c009b50 comp rx=0 tx=0).stop 2023-03-06T13:49:21.590 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.555+0000 7f646db2d700 1 -- 172.21.15.86:0/301396628 shutdown_connections 2023-03-06T13:49:21.590 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.555+0000 7f646db2d700 1 --2- 172.21.15.86:0/301396628 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f646806d070 0x7f646806d4d0 secure :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f645c009840 tx=0x7f645c009b50 comp rx=0 tx=0).stop 2023-03-06T13:49:21.590 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.555+0000 7f646db2d700 1 -- 172.21.15.86:0/301396628 >> 172.21.15.86:0/301396628 conn(0x7f646806ba30 msgr2=0x7f646806be30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T13:49:21.591 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.555+0000 7f646db2d700 1 -- 172.21.15.86:0/301396628 shutdown_connections 2023-03-06T13:49:21.591 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.555+0000 7f646db2d700 1 -- 172.21.15.86:0/301396628 wait complete. 2023-03-06T13:49:21.591 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.556+0000 7fd3acff9700 1 -- 172.21.15.86:0/4072461396 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fd3a4019030 con 0x7fd3b00c09a0 2023-03-06T13:49:21.591 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.556+0000 7fd3acff9700 1 --2- 172.21.15.86:0/4072461396 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7fd39c0683c0 0x7fd39c06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:21.592 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.556+0000 7fd3acff9700 1 -- 172.21.15.86:0/4072461396 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd3a4085860 con 0x7fd3b00c09a0 2023-03-06T13:49:21.592 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.555+0000 7f0c3d103700 1 -- 172.21.15.86:0/1554475592 --> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c3806b460 con 0x7f0c3806b980 2023-03-06T13:49:21.592 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.555+0000 7f0c3d103700 1 -- 172.21.15.86:0/1554475592 --> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c380bfb70 con 0x7f0c3806b980 2023-03-06T13:49:21.592 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.556+0000 7f0c3d103700 1 -- 172.21.15.86:0/1554475592 --> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c380bc820 con 0x7f0c3806b980 2023-03-06T13:49:21.592 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.557+0000 7f3c4e314700 1 Processor -- start 2023-03-06T13:49:21.593 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.557+0000 7fd3affff700 1 --2- 172.21.15.86:0/4072461396 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7fd39c0683c0 0x7fd39c06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:21.593 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.557+0000 7fd3affff700 1 --2- 172.21.15.86:0/4072461396 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7fd39c0683c0 0x7fd39c06a870 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fd3a800ab90 tx=0x7fd3a8009230 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T13:49:21.593 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.557+0000 7f646db2d700 1 Processor -- start 2023-03-06T13:49:21.594 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.557+0000 7f3c4e314700 1 -- start start 2023-03-06T13:49:21.594 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.558+0000 7f3c4e314700 1 --2- >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f3c48145510 0x7f3c4814f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:21.594 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.558+0000 7f3c4e314700 1 --2- >> v2:172.21.15.202:3300/0 conn(0x7f3c480b5fd0 0x7f3c480bc930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:21.595 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.558+0000 7f3c4e314700 1 -- --> v1:172.21.15.202:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c480bc4a0 con 0x7f3c480bd3f0 2023-03-06T13:49:21.595 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.558+0000 7f3c4e314700 1 -- --> v2:172.21.15.202:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c480b7e40 con 0x7f3c480b5fd0 2023-03-06T13:49:21.595 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.558+0000 7f3c4e314700 1 -- --> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c4814f6d0 con 0x7f3c48145510 2023-03-06T13:49:21.595 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.558+0000 7f3c47fff700 1 --2- >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f3c48145510 0x7f3c4814f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:21.595 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.558+0000 7f3c47fff700 1 --2- >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f3c48145510 0x7f3c4814f0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.202:3301/0 says I am v2:172.21.15.86:50750/0 (socket says 172.21.15.86:50750) 2023-03-06T13:49:21.595 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.558+0000 7f3c47fff700 1 -- 172.21.15.86:0/3846358084 learned_addr learned my addr 172.21.15.86:0/3846358084 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-03-06T13:49:21.596 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.557+0000 7f646db2d700 1 -- start start 2023-03-06T13:49:21.596 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.558+0000 7f646db2d700 1 --2- >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f64680b7770 0x7f64680bda80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:21.596 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.558+0000 7f646db2d700 1 --2- >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f646815bd70 0x7f6468140ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:21.596 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.558+0000 7f646db2d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f64681410e0 0x7f64681434f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:21.596 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.559+0000 7f646db2d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6468144c50 con 0x7f64681410e0 2023-03-06T13:49:21.596 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.559+0000 7f646db2d700 1 -- --> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64681498b0 con 0x7f646815bd70 2023-03-06T13:49:21.597 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.559+0000 7f646db2d700 1 -- --> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f646814a1a0 con 0x7f64680b7770 2023-03-06T13:49:21.597 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.559+0000 7f64677fe700 1 --2- >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f64680b7770 0x7f64680bda80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:21.597 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.559+0000 7f64677fe700 1 --2- >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f64680b7770 0x7f64680bda80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.202:3301/0 says I am v2:172.21.15.86:50756/0 (socket says 172.21.15.86:50756) 2023-03-06T13:49:21.597 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.559+0000 7f64677fe700 1 -- 172.21.15.86:0/4169598505 learned_addr learned my addr 172.21.15.86:0/4169598505 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-03-06T13:49:21.597 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.559+0000 7f6467fff700 1 --2- 172.21.15.86:0/4169598505 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f64681410e0 0x7f64681434f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:21.597 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.559+0000 7f3c47fff700 1 -- 172.21.15.86:0/3846358084 >> v2:172.21.15.202:3300/0 conn(0x7f3c480b5fd0 msgr2=0x7f3c480bc930 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-03-06T13:49:21.598 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.559+0000 7f3c47fff700 1 --2- 172.21.15.86:0/3846358084 >> v2:172.21.15.202:3300/0 conn(0x7f3c480b5fd0 0x7f3c480bc930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:21.598 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.559+0000 7f3c47fff700 1 -- 172.21.15.86:0/3846358084 >> v1:172.21.15.202:6789/0 conn(0x7f3c480bd3f0 legacy=0x7f3c4806c8a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-03-06T13:49:21.598 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.559+0000 7f3c47fff700 1 -- 172.21.15.86:0/3846358084 --> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c481458e0 con 0x7f3c48145510 2023-03-06T13:49:21.598 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.559+0000 7f6466ffd700 1 --2- 172.21.15.86:0/4169598505 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f646815bd70 0x7f6468140ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:21.598 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.559+0000 7f64677fe700 1 -- 172.21.15.86:0/4169598505 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f646815bd70 msgr2=0x7f6468140ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:21.599 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.559+0000 7f64677fe700 1 --2- 172.21.15.86:0/4169598505 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f646815bd70 0x7f6468140ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:21.599 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.559+0000 7f64677fe700 1 -- 172.21.15.86:0/4169598505 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f64681410e0 msgr2=0x7f64681434f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:21.599 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.559+0000 7f64677fe700 1 --2- 172.21.15.86:0/4169598505 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f64681410e0 0x7f64681434f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:21.599 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.559+0000 7f64677fe700 1 -- 172.21.15.86:0/4169598505 --> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f645c0094a0 con 0x7f64680b7770 2023-03-06T13:49:21.599 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.559+0000 7f6467fff700 1 --2- 172.21.15.86:0/4169598505 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f64681410e0 0x7f64681434f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-06T13:49:21.599 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.559+0000 7f3c47fff700 1 --2- 172.21.15.86:0/3846358084 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f3c48145510 0x7f3c4814f0f0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f3c38007360 tx=0x7f3c38007670 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9c7e7e06f7106f17 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T13:49:21.600 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.559+0000 7f64677fe700 1 --2- 172.21.15.86:0/4169598505 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f64680b7770 0x7f64680bda80 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f645800c490 tx=0x7f645800c7a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T13:49:21.600 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.560+0000 7f0c2ffff700 1 -- 172.21.15.86:0/1554475592 <== mon.2 v2:172.21.15.202:3301/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f0c20010050 con 0x7f0c3806b980 2023-03-06T13:49:21.601 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.561+0000 7f0c2ffff700 1 --2- 172.21.15.86:0/1554475592 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7f0c18068340 0x7f0c1806a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:21.601 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.561+0000 7f0c36d9d700 1 --2- 172.21.15.86:0/1554475592 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7f0c18068340 0x7f0c1806a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:21.601 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.561+0000 7f0c2ffff700 1 -- 172.21.15.86:0/1554475592 <== mon.2 v2:172.21.15.202:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0c200853c0 con 0x7f0c3806b980 2023-03-06T13:49:21.601 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.561+0000 7f0c36d9d700 1 --2- 172.21.15.86:0/1554475592 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7f0c18068340 0x7f0c1806a7f0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f0c38067770 tx=0x7f0c28009000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T13:49:21.601 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.562+0000 7f644ffff700 1 -- 172.21.15.86:0/4169598505 <== mon.2 v2:172.21.15.202:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f645800cea0 con 0x7f64680b7770 2023-03-06T13:49:21.602 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.562+0000 7f3c46ffd700 1 -- 172.21.15.86:0/3846358084 <== mon.2 v2:172.21.15.202:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c3800a580 con 0x7f3c48145510 2023-03-06T13:49:21.602 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.562+0000 7f3c46ffd700 1 -- 172.21.15.86:0/3846358084 <== mon.2 v2:172.21.15.202:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c3800a6e0 con 0x7f3c48145510 2023-03-06T13:49:21.602 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.562+0000 7f3c46ffd700 1 -- 172.21.15.86:0/3846358084 <== mon.2 v2:172.21.15.202:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c38004230 con 0x7f3c48145510 2023-03-06T13:49:21.602 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.562+0000 7f0c2ffff700 1 -- 172.21.15.86:0/1554475592 <== mon.2 v2:172.21.15.202:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f0c20051bb0 con 0x7f0c3806b980 2023-03-06T13:49:21.603 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.563+0000 7f3c4e314700 1 -- 172.21.15.86:0/3846358084 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f3c48145510 msgr2=0x7f3c4814f0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:21.603 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.563+0000 7f3c4e314700 1 --2- 172.21.15.86:0/3846358084 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f3c48145510 0x7f3c4814f0f0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f3c38007360 tx=0x7f3c38007670 comp rx=0 tx=0).stop 2023-03-06T13:49:21.603 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.562+0000 7f644ffff700 1 -- 172.21.15.86:0/4169598505 <== mon.2 v2:172.21.15.202:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6458005d70 con 0x7f64680b7770 2023-03-06T13:49:21.603 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.562+0000 7f644ffff700 1 -- 172.21.15.86:0/4169598505 <== mon.2 v2:172.21.15.202:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64580072f0 con 0x7f64680b7770 2023-03-06T13:49:21.604 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.564+0000 7efddeffd700 1 -- 172.21.15.86:0/2056288743 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efde8004830 con 0x7efdf00c1e30 2023-03-06T13:49:21.604 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.564+0000 7efddeffd700 1 -- 172.21.15.86:0/2056288743 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efde8020070 con 0x7efdf00c1e30 2023-03-06T13:49:21.604 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.564+0000 7efddeffd700 1 -- 172.21.15.86:0/2056288743 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efde8027680 con 0x7efdf00c1e30 2023-03-06T13:49:21.605 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.564+0000 7f646db2d700 1 -- 172.21.15.86:0/4169598505 --> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f646806cb50 con 0x7f64680b7770 2023-03-06T13:49:21.605 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.564+0000 7f646db2d700 1 -- 172.21.15.86:0/4169598505 --> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64681542c0 con 0x7f64680b7770 2023-03-06T13:49:21.605 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.565+0000 7f644ffff700 1 -- 172.21.15.86:0/4169598505 <== mon.2 v2:172.21.15.202:3301/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f6458019030 con 0x7f64680b7770 2023-03-06T13:49:21.605 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.566+0000 7f644ffff700 1 --2- 172.21.15.86:0/4169598505 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7f6454068320 0x7f645406a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:21.605 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.566+0000 7f644ffff700 1 -- 172.21.15.86:0/4169598505 <== mon.2 v2:172.21.15.202:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f6458084ed0 con 0x7f64680b7770 2023-03-06T13:49:21.606 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.564+0000 7f3c4e314700 1 -- 172.21.15.86:0/3846358084 shutdown_connections 2023-03-06T13:49:21.606 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.564+0000 7f3c4e314700 1 --2- 172.21.15.86:0/3846358084 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f3c48145510 0x7f3c4814f0f0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:21.606 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.564+0000 7f3c4e314700 1 --2- 172.21.15.86:0/3846358084 >> v2:172.21.15.202:3300/0 conn(0x7f3c480b5fd0 0x7f3c480bc930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:21.606 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.564+0000 7f3c4e314700 1 -- 172.21.15.86:0/3846358084 >> 172.21.15.86:0/3846358084 conn(0x7f3c4806afc0 msgr2=0x7f3c480c1050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T13:49:21.606 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.565+0000 7f3c4e314700 1 -- 172.21.15.86:0/3846358084 shutdown_connections 2023-03-06T13:49:21.606 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.566+0000 7f3c4e314700 1 -- 172.21.15.86:0/3846358084 wait complete. 2023-03-06T13:49:21.606 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.567+0000 7f3c4e314700 1 Processor -- start 2023-03-06T13:49:21.607 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.565+0000 7efdf49ed700 1 -- 172.21.15.86:0/2056288743 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efde8009a70 con 0x7efdf00c1e30 2023-03-06T13:49:21.607 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.565+0000 7efdf49ed700 1 -- 172.21.15.86:0/2056288743 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efdf006fca0 con 0x7efdf00c1e30 2023-03-06T13:49:21.607 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.567+0000 7efddeffd700 1 -- 172.21.15.86:0/2056288743 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7efde80277e0 con 0x7efdf00c1e30 2023-03-06T13:49:21.607 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.567+0000 7efdf49ed700 1 -- 172.21.15.86:0/2056288743 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efdf0072780 con 0x7efdf00c1e30 2023-03-06T13:49:21.607 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.567+0000 7efddeffd700 1 --2- 172.21.15.86:0/2056288743 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7efdd00683c0 0x7efdd006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:21.607 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.567+0000 7efddeffd700 1 -- 172.21.15.86:0/2056288743 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7efde8022070 con 0x7efdf00c1e30 2023-03-06T13:49:21.608 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.565+0000 7fd3acff9700 1 -- 172.21.15.86:0/4072461396 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fd3a4052100 con 0x7fd3b00c09a0 2023-03-06T13:49:21.608 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.568+0000 7f3c4e314700 1 -- start start 2023-03-06T13:49:21.608 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.569+0000 7f3c4e314700 1 --2- >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f3c480b5fd0 0x7f3c481d6f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:21.608 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.569+0000 7f3c4e314700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3c480bd3f0 0x7f3c480712d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:21.609 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.569+0000 7f3c4e314700 1 --2- >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f3c48145510 0x7f3c481f4a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:21.609 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.569+0000 7f3c4e314700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c481f1490 con 0x7f3c480bd3f0 2023-03-06T13:49:21.609 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.569+0000 7f3c4e314700 1 -- --> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c48070e40 con 0x7f3c48145510 2023-03-06T13:49:21.609 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.569+0000 7f3c4e314700 1 -- --> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c481d7460 con 0x7f3c480b5fd0 2023-03-06T13:49:21.609 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.569+0000 7f3c477fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3c480bd3f0 0x7f3c480712d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:21.609 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.569+0000 7f3c477fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3c480bd3f0 0x7f3c480712d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:39078/0 (socket says 172.21.15.86:39078) 2023-03-06T13:49:21.609 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.569+0000 7f3c477fe700 1 -- 172.21.15.86:0/57192081 learned_addr learned my addr 172.21.15.86:0/57192081 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-03-06T13:49:21.610 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.569+0000 7f3c47fff700 1 --2- 172.21.15.86:0/57192081 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f3c480b5fd0 0x7f3c481d6f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:21.610 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.569+0000 7f3c477fe700 1 -- 172.21.15.86:0/57192081 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f3c480b5fd0 msgr2=0x7f3c481d6f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:21.610 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.569+0000 7f3c477fe700 1 --2- 172.21.15.86:0/57192081 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f3c480b5fd0 0x7f3c481d6f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:21.610 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.569+0000 7f3c477fe700 1 -- 172.21.15.86:0/57192081 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f3c48145510 msgr2=0x7f3c481f4a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:21.610 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.569+0000 7f3c477fe700 1 --2- 172.21.15.86:0/57192081 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f3c48145510 0x7f3c481f4a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:21.610 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.570+0000 7f3c477fe700 1 -- 172.21.15.86:0/57192081 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c38007040 con 0x7f3c480bd3f0 2023-03-06T13:49:21.610 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.570+0000 7f3c47fff700 1 --2- 172.21.15.86:0/57192081 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f3c480b5fd0 0x7f3c481d6f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-06T13:49:21.611 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.570+0000 7f646db2d700 1 -- 172.21.15.86:0/4169598505 --> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6468072430 con 0x7f64680b7770 2023-03-06T13:49:21.611 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.570+0000 7f3c477fe700 1 --2- 172.21.15.86:0/57192081 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3c480bd3f0 0x7f3c480712d0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f3c4000b870 tx=0x7f3c4000bc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T13:49:21.611 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.572+0000 7f3c44ff9700 1 -- 172.21.15.86:0/57192081 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c4000d8e0 con 0x7f3c480bd3f0 2023-03-06T13:49:21.612 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.572+0000 7f3c44ff9700 1 -- 172.21.15.86:0/57192081 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c4000da40 con 0x7f3c480bd3f0 2023-03-06T13:49:21.612 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.572+0000 7f3c44ff9700 1 -- 172.21.15.86:0/57192081 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c4000ddf0 con 0x7f3c480bd3f0 2023-03-06T13:49:21.612 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.572+0000 7f3c4e314700 1 -- 172.21.15.86:0/57192081 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c480bbe50 con 0x7f3c480bd3f0 2023-03-06T13:49:21.612 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.572+0000 7efddeffd700 1 -- 172.21.15.86:0/2056288743 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7efde8054a40 con 0x7efdf00c1e30 2023-03-06T13:49:21.613 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.572+0000 7f3c4e314700 1 -- 172.21.15.86:0/57192081 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c480bbb70 con 0x7f3c480bd3f0 2023-03-06T13:49:21.613 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.573+0000 7f3c4e314700 1 -- 172.21.15.86:0/57192081 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c280052e0 con 0x7f3c480bd3f0 2023-03-06T13:49:21.613 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.575+0000 7f6466ffd700 1 --2- 172.21.15.86:0/4169598505 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7f6454068320 0x7f645406a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:21.613 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.575+0000 7f6466ffd700 1 --2- 172.21.15.86:0/4169598505 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7f6454068320 0x7f645406a7d0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f646806d440 tx=0x7f645c01c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T13:49:21.614 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.583+0000 7efdee59c700 1 --2- 172.21.15.86:0/2056288743 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7efdd00683c0 0x7efdd006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:21.614 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.574+0000 7f3c44ff9700 1 -- 172.21.15.86:0/57192081 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f3c40015420 con 0x7f3c480bd3f0 2023-03-06T13:49:21.614 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.575+0000 7f3c44ff9700 1 --2- 172.21.15.86:0/57192081 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7f3c340682f0 0x7f3c3406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:21.615 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.575+0000 7f3c44ff9700 1 -- 172.21.15.86:0/57192081 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3c40011070 con 0x7f3c480bd3f0 2023-03-06T13:49:21.615 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.575+0000 7f3c47fff700 1 --2- 172.21.15.86:0/57192081 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7f3c340682f0 0x7f3c3406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:21.615 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.576+0000 7f3c47fff700 1 --2- 172.21.15.86:0/57192081 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7f3c340682f0 0x7f3c3406a7a0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f3c38000c00 tx=0x7f3c38012000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T13:49:21.615 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.583+0000 7f644ffff700 1 -- 172.21.15.86:0/4169598505 <== mon.2 v2:172.21.15.202:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f6458017080 con 0x7f64680b7770 2023-03-06T13:49:21.616 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.583+0000 7efdee59c700 1 --2- 172.21.15.86:0/2056288743 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7efdd00683c0 0x7efdd006a870 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7efde0015460 tx=0x7efde000f040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T13:49:21.616 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.583+0000 7f3c44ff9700 1 -- 172.21.15.86:0/57192081 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f3c40052d20 con 0x7f3c480bd3f0 2023-03-06T13:49:21.889 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.885+0000 7fa738afd700 1 -- 172.21.15.86:0/146585678 --> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fa718005590 con 0x7fa73413f820 2023-03-06T13:49:21.890 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.886+0000 7fa722ffd700 1 -- 172.21.15.86:0/146585678 <== mon.2 v2:172.21.15.202:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa72c056e90 con 0x7fa73413f820 2023-03-06T13:49:21.890 INFO:teuthology.orchestra.run.smithi086.stdout:55834574855 2023-03-06T13:49:21.893 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.891+0000 7fa738afd700 1 -- 172.21.15.86:0/146585678 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7fa714068390 msgr2=0x7fa71406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:21.893 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.891+0000 7fa738afd700 1 --2- 172.21.15.86:0/146585678 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7fa714068390 0x7fa71406a840 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fa734067dc0 tx=0x7fa728007a20 comp rx=0 tx=0).stop 2023-03-06T13:49:21.893 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.891+0000 7fa738afd700 1 -- 172.21.15.86:0/146585678 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fa73413f820 msgr2=0x7fa734140aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:21.893 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.891+0000 7fa738afd700 1 --2- 172.21.15.86:0/146585678 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fa73413f820 0x7fa734140aa0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fa72c017000 tx=0x7fa72c004ad0 comp rx=0 tx=0).stop 2023-03-06T13:49:21.894 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.891+0000 7fa738afd700 1 -- 172.21.15.86:0/146585678 shutdown_connections 2023-03-06T13:49:21.894 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.891+0000 7fa738afd700 1 --2- 172.21.15.86:0/146585678 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7fa714068390 0x7fa71406a840 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:21.894 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.891+0000 7fa738afd700 1 --2- 172.21.15.86:0/146585678 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fa73413f820 0x7fa734140aa0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:21.894 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.891+0000 7fa738afd700 1 --2- 172.21.15.86:0/146585678 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7fa7340b5fd0 0x7fa7340c0d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:21.894 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.891+0000 7fa738afd700 1 --2- 172.21.15.86:0/146585678 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa7340bd3f0 0x7fa7341dffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:21.894 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.891+0000 7fa738afd700 1 -- 172.21.15.86:0/146585678 >> 172.21.15.86:0/146585678 conn(0x7fa73406afc0 msgr2=0x7fa73406ced0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T13:49:21.894 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.891+0000 7fa738afd700 1 -- 172.21.15.86:0/146585678 shutdown_connections 2023-03-06T13:49:21.895 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.891+0000 7fa738afd700 1 -- 172.21.15.86:0/146585678 wait complete. 2023-03-06T13:49:21.895 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.890+0000 7fae3b7bc700 1 -- 172.21.15.86:0/3243000203 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fae34145ed0 con 0x7fae34145510 2023-03-06T13:49:21.896 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.893+0000 7fae29ffb700 1 -- 172.21.15.86:0/3243000203 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fae30031020 con 0x7fae34145510 2023-03-06T13:49:21.903 INFO:teuthology.orchestra.run.smithi086.stdout:55834574854 2023-03-06T13:49:21.904 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.902+0000 7fae3b7bc700 1 -- 172.21.15.86:0/3243000203 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7fae18068320 msgr2=0x7fae1806a7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:21.904 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.902+0000 7fae3b7bc700 1 --2- 172.21.15.86:0/3243000203 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7fae18068320 0x7fae1806a7d0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fae2400b850 tx=0x7fae24008040 comp rx=0 tx=0).stop 2023-03-06T13:49:21.904 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.902+0000 7fae3b7bc700 1 -- 172.21.15.86:0/3243000203 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fae34145510 msgr2=0x7fae34146080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:21.904 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.902+0000 7fae3b7bc700 1 --2- 172.21.15.86:0/3243000203 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fae34145510 0x7fae34146080 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fae300090b0 tx=0x7fae30004750 comp rx=0 tx=0).stop 2023-03-06T13:49:21.905 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.903+0000 7fae3b7bc700 1 -- 172.21.15.86:0/3243000203 shutdown_connections 2023-03-06T13:49:21.905 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.903+0000 7fae3b7bc700 1 --2- 172.21.15.86:0/3243000203 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7fae18068320 0x7fae1806a7d0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:21.905 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.903+0000 7fae3b7bc700 1 --2- 172.21.15.86:0/3243000203 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fae341396b0 0x7fae341465c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:21.905 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.903+0000 7fae3b7bc700 1 --2- 172.21.15.86:0/3243000203 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7fae340bd3f0 0x7fae3413e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:21.905 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.903+0000 7fae3b7bc700 1 --2- 172.21.15.86:0/3243000203 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fae34145510 0x7fae34146080 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:21.906 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.903+0000 7fae3b7bc700 1 -- 172.21.15.86:0/3243000203 >> 172.21.15.86:0/3243000203 conn(0x7fae3406afc0 msgr2=0x7fae3413fc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T13:49:21.906 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.903+0000 7fae3b7bc700 1 -- 172.21.15.86:0/3243000203 shutdown_connections 2023-03-06T13:49:21.906 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.903+0000 7fae3b7bc700 1 -- 172.21.15.86:0/3243000203 wait complete. 2023-03-06T13:49:21.914 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.3 2023-03-06T13:49:21.914 DEBUG:teuthology.parallel:result is None 2023-03-06T13:49:21.923 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.4 2023-03-06T13:49:21.923 DEBUG:teuthology.parallel:result is None 2023-03-06T13:49:21.934 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.932+0000 7fd3b63fb700 1 -- 172.21.15.86:0/4072461396 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fd3b004e750 con 0x7fd3b00c09a0 2023-03-06T13:49:21.935 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.933+0000 7fd3acff9700 1 -- 172.21.15.86:0/4072461396 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd3a4055720 con 0x7fd3b00c09a0 2023-03-06T13:49:21.935 INFO:teuthology.orchestra.run.smithi086.stdout:55834574855 2023-03-06T13:49:21.940 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.935+0000 7fd3b63fb700 1 -- 172.21.15.86:0/4072461396 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7fd39c0683c0 msgr2=0x7fd39c06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:21.941 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.935+0000 7fd3b63fb700 1 --2- 172.21.15.86:0/4072461396 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7fd39c0683c0 0x7fd39c06a870 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fd3a800ab90 tx=0x7fd3a8009230 comp rx=0 tx=0).stop 2023-03-06T13:49:21.941 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.935+0000 7fd3b63fb700 1 -- 172.21.15.86:0/4072461396 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd3b00c09a0 msgr2=0x7fd3b01f5570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:21.941 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.935+0000 7fd3b63fb700 1 --2- 172.21.15.86:0/4072461396 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd3b00c09a0 0x7fd3b01f5570 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fd3a400c4c0 tx=0x7fd3a4001e70 comp rx=0 tx=0).stop 2023-03-06T13:49:21.941 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.935+0000 7fd3b63fb700 1 -- 172.21.15.86:0/4072461396 shutdown_connections 2023-03-06T13:49:21.941 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.935+0000 7fd3b63fb700 1 --2- 172.21.15.86:0/4072461396 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7fd39c0683c0 0x7fd39c06a870 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:21.941 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.935+0000 7fd3b63fb700 1 --2- 172.21.15.86:0/4072461396 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd3b00c09a0 0x7fd3b01f5570 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:21.942 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.935+0000 7fd3b63fb700 1 --2- 172.21.15.86:0/4072461396 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7fd3b00bd3f0 0x7fd3b014d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:21.942 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.935+0000 7fd3b63fb700 1 --2- 172.21.15.86:0/4072461396 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fd3b0145510 0x7fd3b01f5030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:21.942 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.935+0000 7fd3b63fb700 1 -- 172.21.15.86:0/4072461396 >> 172.21.15.86:0/4072461396 conn(0x7fd3b006afc0 msgr2=0x7fd3b01d9c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T13:49:21.942 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.936+0000 7fd3b63fb700 1 -- 172.21.15.86:0/4072461396 shutdown_connections 2023-03-06T13:49:21.942 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.936+0000 7fa70a2f8700 1 -- 172.21.15.86:0/586648492 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fa70404e750 con 0x7fa7040c19d0 2023-03-06T13:49:21.943 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.936+0000 7fa700ff9700 1 -- 172.21.15.86:0/586648492 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa6fc019020 con 0x7fa7040c19d0 2023-03-06T13:49:21.943 INFO:teuthology.orchestra.run.smithi086.stdout:55834574855 2023-03-06T13:49:21.943 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.937+0000 7fd3b63fb700 1 -- 172.21.15.86:0/4072461396 wait complete. 2023-03-06T13:49:21.944 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.937+0000 7f0c3d103700 1 -- 172.21.15.86:0/1554475592 --> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f0c380c0c40 con 0x7f0c3806b980 2023-03-06T13:49:21.944 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.938+0000 7f0c2ffff700 1 -- 172.21.15.86:0/1554475592 <== mon.2 v2:172.21.15.202:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0c380c0c40 con 0x7f0c3806b980 2023-03-06T13:49:21.944 INFO:teuthology.orchestra.run.smithi086.stdout:55834574853 2023-03-06T13:49:21.945 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.939+0000 7fa70a2f8700 1 -- 172.21.15.86:0/586648492 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7fa6ec0684a0 msgr2=0x7fa6ec06a950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:21.945 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.939+0000 7fa70a2f8700 1 --2- 172.21.15.86:0/586648492 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7fa6ec0684a0 0x7fa6ec06a950 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fa6f8008c10 tx=0x7fa6f800c000 comp rx=0 tx=0).stop 2023-03-06T13:49:21.945 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.939+0000 7fa70a2f8700 1 -- 172.21.15.86:0/586648492 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa7040c19d0 msgr2=0x7fa7041e8600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:21.945 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.939+0000 7fa70a2f8700 1 --2- 172.21.15.86:0/586648492 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa7040c19d0 0x7fa7041e8600 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fa6fc00b970 tx=0x7fa6fc00bc80 comp rx=0 tx=0).stop 2023-03-06T13:49:21.946 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.940+0000 7f0c3d103700 1 -- 172.21.15.86:0/1554475592 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7f0c18068340 msgr2=0x7f0c1806a7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:21.946 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.940+0000 7f0c3d103700 1 --2- 172.21.15.86:0/1554475592 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7f0c18068340 0x7f0c1806a7f0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f0c38067770 tx=0x7f0c28009000 comp rx=0 tx=0).stop 2023-03-06T13:49:21.946 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.940+0000 7f0c3d103700 1 -- 172.21.15.86:0/1554475592 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f0c3806b980 msgr2=0x7f0c380a2570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:21.946 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.940+0000 7f0c3d103700 1 --2- 172.21.15.86:0/1554475592 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f0c3806b980 0x7f0c380a2570 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f0c2000c400 tx=0x7f0c2000c710 comp rx=0 tx=0).stop 2023-03-06T13:49:21.947 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.940+0000 7f0c3d103700 1 -- 172.21.15.86:0/1554475592 shutdown_connections 2023-03-06T13:49:21.947 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.940+0000 7f0c3d103700 1 --2- 172.21.15.86:0/1554475592 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7f0c18068340 0x7f0c1806a7f0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:21.947 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.940+0000 7f0c3d103700 1 --2- 172.21.15.86:0/1554475592 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0c380a6660 0x7f0c38148fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:21.947 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.940+0000 7f0c3d103700 1 --2- 172.21.15.86:0/1554475592 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f0c38065fb0 0x7f0c380a4840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:21.947 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.940+0000 7f0c3d103700 1 --2- 172.21.15.86:0/1554475592 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f0c3806b980 0x7f0c380a2570 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:21.947 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.940+0000 7f0c3d103700 1 -- 172.21.15.86:0/1554475592 >> 172.21.15.86:0/1554475592 conn(0x7f0c380a4180 msgr2=0x7f0c380bca40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T13:49:21.948 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.941+0000 7fa70a2f8700 1 -- 172.21.15.86:0/586648492 shutdown_connections 2023-03-06T13:49:21.948 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.941+0000 7fa70a2f8700 1 --2- 172.21.15.86:0/586648492 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7fa6ec0684a0 0x7fa6ec06a950 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:21.948 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.941+0000 7fa70a2f8700 1 --2- 172.21.15.86:0/586648492 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa7040c19d0 0x7fa7041e8600 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:21.948 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.941+0000 7fa70a2f8700 1 --2- 172.21.15.86:0/586648492 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fa70406cde0 0x7fa704072190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:21.948 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.941+0000 7fa70a2f8700 1 --2- 172.21.15.86:0/586648492 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7fa7040bc1f0 0x7fa70406f760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:21.948 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.941+0000 7fa70a2f8700 1 -- 172.21.15.86:0/586648492 >> 172.21.15.86:0/586648492 conn(0x7fa70406afc0 msgr2=0x7fa7040be300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T13:49:21.949 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.941+0000 7f0c3d103700 1 -- 172.21.15.86:0/1554475592 shutdown_connections 2023-03-06T13:49:21.949 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.941+0000 7f0c3d103700 1 -- 172.21.15.86:0/1554475592 wait complete. 2023-03-06T13:49:21.950 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.942+0000 7fa70a2f8700 1 -- 172.21.15.86:0/586648492 shutdown_connections 2023-03-06T13:49:21.950 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.942+0000 7fa70a2f8700 1 -- 172.21.15.86:0/586648492 wait complete. 2023-03-06T13:49:21.954 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.7 2023-03-06T13:49:21.955 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.952+0000 7efdf49ed700 1 -- 172.21.15.86:0/2056288743 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7efdf0070260 con 0x7efdf00c1e30 2023-03-06T13:49:21.955 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.952+0000 7efddeffd700 1 -- 172.21.15.86:0/2056288743 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7efde8058060 con 0x7efdf00c1e30 2023-03-06T13:49:21.955 DEBUG:teuthology.parallel:result is None 2023-03-06T13:49:21.956 INFO:teuthology.orchestra.run.smithi086.stdout:55834574855 2023-03-06T13:49:21.958 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.955+0000 7efdf49ed700 1 -- 172.21.15.86:0/2056288743 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7efdd00683c0 msgr2=0x7efdd006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:21.958 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.955+0000 7efdf49ed700 1 --2- 172.21.15.86:0/2056288743 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7efdd00683c0 0x7efdd006a870 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7efde0015460 tx=0x7efde000f040 comp rx=0 tx=0).stop 2023-03-06T13:49:21.958 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.955+0000 7efdf49ed700 1 -- 172.21.15.86:0/2056288743 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efdf00c1e30 msgr2=0x7efdf0140490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:21.959 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.955+0000 7efdf49ed700 1 --2- 172.21.15.86:0/2056288743 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efdf00c1e30 0x7efdf0140490 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7efde8016000 tx=0x7efde8004ad0 comp rx=0 tx=0).stop 2023-03-06T13:49:21.959 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.956+0000 7efdf49ed700 1 -- 172.21.15.86:0/2056288743 shutdown_connections 2023-03-06T13:49:21.959 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.956+0000 7efdf49ed700 1 --2- 172.21.15.86:0/2056288743 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7efdd00683c0 0x7efdd006a870 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:21.959 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.956+0000 7efdf49ed700 1 --2- 172.21.15.86:0/2056288743 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efdf00c1e30 0x7efdf0140490 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:21.959 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.956+0000 7efdf49ed700 1 --2- 172.21.15.86:0/2056288743 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7efdf00703f0 0x7efdf0145c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:21.959 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.956+0000 7efdf49ed700 1 --2- 172.21.15.86:0/2056288743 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7efdf00bd9a0 0x7efdf01e4330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:21.959 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.956+0000 7efdf49ed700 1 -- 172.21.15.86:0/2056288743 >> 172.21.15.86:0/2056288743 conn(0x7efdf006c6c0 msgr2=0x7efdf006d410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T13:49:21.960 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.956+0000 7f646db2d700 1 -- 172.21.15.86:0/4169598505 --> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f64680bdfc0 con 0x7f64680b7770 2023-03-06T13:49:21.960 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.957+0000 7f644ffff700 1 -- 172.21.15.86:0/4169598505 <== mon.2 v2:172.21.15.202:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f6458051730 con 0x7f64680b7770 2023-03-06T13:49:21.960 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.957+0000 7efdf49ed700 1 -- 172.21.15.86:0/2056288743 shutdown_connections 2023-03-06T13:49:21.961 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.957+0000 7efdf49ed700 1 -- 172.21.15.86:0/2056288743 wait complete. 2023-03-06T13:49:21.961 INFO:teuthology.orchestra.run.smithi086.stdout:55834574855 2023-03-06T13:49:21.961 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.960+0000 7f646db2d700 1 -- 172.21.15.86:0/4169598505 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7f6454068320 msgr2=0x7f645406a7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:21.961 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.960+0000 7f646db2d700 1 --2- 172.21.15.86:0/4169598505 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7f6454068320 0x7f645406a7d0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f646806d440 tx=0x7f645c01c040 comp rx=0 tx=0).stop 2023-03-06T13:49:21.962 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.960+0000 7f646db2d700 1 -- 172.21.15.86:0/4169598505 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f64680b7770 msgr2=0x7f64680bda80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:21.963 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.960+0000 7f646db2d700 1 --2- 172.21.15.86:0/4169598505 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f64680b7770 0x7f64680bda80 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f645800c490 tx=0x7f645800c7a0 comp rx=0 tx=0).stop 2023-03-06T13:49:21.964 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.0 2023-03-06T13:49:21.964 DEBUG:teuthology.parallel:result is None 2023-03-06T13:49:21.965 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.962+0000 7f646db2d700 1 -- 172.21.15.86:0/4169598505 shutdown_connections 2023-03-06T13:49:21.965 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.962+0000 7f646db2d700 1 --2- 172.21.15.86:0/4169598505 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7f6454068320 0x7f645406a7d0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:21.965 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.962+0000 7f646db2d700 1 --2- 172.21.15.86:0/4169598505 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f64681410e0 0x7f64681434f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:21.965 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.962+0000 7f646db2d700 1 --2- 172.21.15.86:0/4169598505 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f64680b7770 0x7f64680bda80 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:21.965 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.962+0000 7f646db2d700 1 --2- 172.21.15.86:0/4169598505 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f646815bd70 0x7f6468140ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:21.965 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.962+0000 7f646db2d700 1 -- 172.21.15.86:0/4169598505 >> 172.21.15.86:0/4169598505 conn(0x7f646806ba30 msgr2=0x7f6468070820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T13:49:21.966 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.962+0000 7f646db2d700 1 -- 172.21.15.86:0/4169598505 shutdown_connections 2023-03-06T13:49:21.966 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.962+0000 7f646db2d700 1 -- 172.21.15.86:0/4169598505 wait complete. 2023-03-06T13:49:21.966 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.2 2023-03-06T13:49:21.967 DEBUG:teuthology.parallel:result is None 2023-03-06T13:49:21.976 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.6 2023-03-06T13:49:21.977 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.975+0000 7f3c4e314700 1 -- 172.21.15.86:0/57192081 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f3c28005860 con 0x7f3c480bd3f0 2023-03-06T13:49:21.977 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.975+0000 7f3c44ff9700 1 -- 172.21.15.86:0/57192081 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3c40056340 con 0x7f3c480bd3f0 2023-03-06T13:49:21.977 DEBUG:teuthology.parallel:result is None 2023-03-06T13:49:21.978 INFO:teuthology.orchestra.run.smithi086.stdout:55834574855 2023-03-06T13:49:21.978 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.5 2023-03-06T13:49:21.979 DEBUG:teuthology.parallel:result is None 2023-03-06T13:49:21.979 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.977+0000 7f3c4e314700 1 -- 172.21.15.86:0/57192081 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7f3c340682f0 msgr2=0x7f3c3406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:21.980 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.977+0000 7f3c4e314700 1 --2- 172.21.15.86:0/57192081 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7f3c340682f0 0x7f3c3406a7a0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f3c38000c00 tx=0x7f3c38012000 comp rx=0 tx=0).stop 2023-03-06T13:49:21.980 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.977+0000 7f3c4e314700 1 -- 172.21.15.86:0/57192081 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3c480bd3f0 msgr2=0x7f3c480712d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:21.980 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.977+0000 7f3c4e314700 1 --2- 172.21.15.86:0/57192081 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3c480bd3f0 0x7f3c480712d0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f3c4000b870 tx=0x7f3c4000bc30 comp rx=0 tx=0).stop 2023-03-06T13:49:21.980 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.977+0000 7f3c4e314700 1 -- 172.21.15.86:0/57192081 shutdown_connections 2023-03-06T13:49:21.980 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.977+0000 7f3c4e314700 1 --2- 172.21.15.86:0/57192081 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7f3c340682f0 0x7f3c3406a7a0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:21.980 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.977+0000 7f3c4e314700 1 --2- 172.21.15.86:0/57192081 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f3c48145510 0x7f3c481f4a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:21.981 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.977+0000 7f3c4e314700 1 --2- 172.21.15.86:0/57192081 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f3c480b5fd0 0x7f3c481d6f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:21.981 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.977+0000 7f3c4e314700 1 --2- 172.21.15.86:0/57192081 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3c480bd3f0 0x7f3c480712d0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:21.981 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.977+0000 7f3c4e314700 1 -- 172.21.15.86:0/57192081 >> 172.21.15.86:0/57192081 conn(0x7f3c4806afc0 msgr2=0x7f3c480a5fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T13:49:21.981 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.977+0000 7f3c4e314700 1 -- 172.21.15.86:0/57192081 shutdown_connections 2023-03-06T13:49:21.981 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:21.977+0000 7f3c4e314700 1 -- 172.21.15.86:0/57192081 wait complete. 2023-03-06T13:49:21.991 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.1 2023-03-06T13:49:21.991 DEBUG:teuthology.parallel:result is None 2023-03-06T13:49:21.992 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-03-06T13:49:21.992 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-03-06T13:49:22.151 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:22.149+0000 7f416a922700 1 Processor -- start 2023-03-06T13:49:22.151 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:22.149+0000 7f416a922700 1 -- start start 2023-03-06T13:49:22.155 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:22.150+0000 7f416a922700 1 --2- >> v2:172.21.15.202:3300/0 conn(0x7f41640c2860 0x7f41640c2c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:22.155 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:22.150+0000 7f416a922700 1 --2- >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f416414fe60 0x7f4164156770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:22.155 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:22.150+0000 7f416a922700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4164146310 con 0x7f41640bd220 2023-03-06T13:49:22.155 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:22.150+0000 7f416a922700 1 -- --> v2:172.21.15.202:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f416406d420 con 0x7f41640c2860 2023-03-06T13:49:22.155 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:22.150+0000 7f416a922700 1 -- --> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f416414cc50 con 0x7f416414fe60 2023-03-06T13:49:22.155 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:22.150+0000 7f41637fe700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f41640bd220 0x7f416414f750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:49230/0 (socket says 172.21.15.86:49230) 2023-03-06T13:49:22.156 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:22.150+0000 7f41637fe700 1 -- 172.21.15.86:0/3419985400 learned_addr learned my addr 172.21.15.86:0/3419985400 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-03-06T13:49:22.156 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:22.150+0000 7f4168ebf700 1 --2- 172.21.15.86:0/3419985400 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f416414fe60 0x7f4164156770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:22.156 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:22.150+0000 7f4163fff700 1 --2- 172.21.15.86:0/3419985400 >> v2:172.21.15.202:3300/0 conn(0x7f41640c2860 0x7f41640c2c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:22.156 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:22.150+0000 7f4162ffd700 1 -- 172.21.15.86:0/3419985400 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4129413524 0 0) 0x7f4154001110 con 0x7f41640bd220 2023-03-06T13:49:22.156 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:22.150+0000 7f4162ffd700 1 -- 172.21.15.86:0/3419985400 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f414c0035b0 con 0x7f41640bd220 2023-03-06T13:49:22.156 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:22.150+0000 7f4162ffd700 1 -- 172.21.15.86:0/3419985400 <== mon.0 v1:172.21.15.86:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2041435222 0 0) 0x7f414c0035b0 con 0x7f41640bd220 2023-03-06T13:49:22.156 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:22.150+0000 7f4162ffd700 1 -- 172.21.15.86:0/3419985400 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f416414fe60 msgr2=0x7f4164156770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T13:49:22.157 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:22.150+0000 7f4162ffd700 1 --2- 172.21.15.86:0/3419985400 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f416414fe60 0x7f4164156770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:22.157 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:22.150+0000 7f4162ffd700 1 -- 172.21.15.86:0/3419985400 >> v2:172.21.15.202:3300/0 conn(0x7f41640c2860 msgr2=0x7f41640c2c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T13:49:22.157 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:22.150+0000 7f4162ffd700 1 --2- 172.21.15.86:0/3419985400 >> v2:172.21.15.202:3300/0 conn(0x7f41640c2860 0x7f41640c2c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:22.157 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:22.150+0000 7f4162ffd700 1 -- 172.21.15.86:0/3419985400 --> v1:172.21.15.86:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41640bd770 con 0x7f41640bd220 2023-03-06T13:49:22.157 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:22.150+0000 7f4162ffd700 1 -- 172.21.15.86:0/3419985400 <== mon.0 v1:172.21.15.86:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2191261126 0 0) 0x7f4154001800 con 0x7f41640bd220 2023-03-06T13:49:22.157 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:22.150+0000 7f4162ffd700 1 -- 172.21.15.86:0/3419985400 >> v1:172.21.15.86:6789/0 conn(0x7f41640bd220 legacy=0x7f416414f750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:22.157 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:22.150+0000 7f4162ffd700 1 --2- 172.21.15.86:0/3419985400 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f414c003a70 0x7f414c003e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:22.157 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:22.150+0000 7f4162ffd700 1 --2- 172.21.15.86:0/3419985400 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f414c004850 0x7f414c004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:22.158 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:22.150+0000 7f4162ffd700 1 --2- 172.21.15.86:0/3419985400 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f414c005200 0x7f414c00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:22.158 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:22.150+0000 7f4162ffd700 1 -- 172.21.15.86:0/3419985400 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f416406d420 con 0x7f414c003a70 2023-03-06T13:49:22.158 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:22.150+0000 7f4162ffd700 1 -- 172.21.15.86:0/3419985400 --> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f416414cc50 con 0x7f414c005200 2023-03-06T13:49:22.158 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:22.150+0000 7f4162ffd700 1 -- 172.21.15.86:0/3419985400 --> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f414c00bfd0 con 0x7f414c004850 2023-03-06T13:49:22.158 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:22.150+0000 7f4163fff700 1 --2- 172.21.15.86:0/3419985400 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f414c003a70 0x7f414c003e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:22.158 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:22.151+0000 7f41637fe700 1 --2- 172.21.15.86:0/3419985400 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f414c004850 0x7f414c004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:22.158 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:22.151+0000 7f4168ebf700 1 --2- 172.21.15.86:0/3419985400 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f414c005200 0x7f414c00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:22.159 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:22.151+0000 7f4163fff700 1 -- 172.21.15.86:0/3419985400 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f414c004850 msgr2=0x7f414c004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T13:49:22.159 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:22.151+0000 7f4163fff700 1 --2- 172.21.15.86:0/3419985400 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f414c004850 0x7f414c004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:22.159 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:22.151+0000 7f4163fff700 1 -- 172.21.15.86:0/3419985400 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f414c005200 msgr2=0x7f414c00ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T13:49:22.159 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:22.151+0000 7f4163fff700 1 --2- 172.21.15.86:0/3419985400 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f414c005200 0x7f414c00ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:22.159 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:22.151+0000 7f4163fff700 1 -- 172.21.15.86:0/3419985400 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f414c0035b0 con 0x7f414c003a70 2023-03-06T13:49:22.160 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:22.151+0000 7f4168ebf700 1 --2- 172.21.15.86:0/3419985400 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f414c005200 0x7f414c00ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-06T13:49:22.160 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:22.151+0000 7f4163fff700 1 --2- 172.21.15.86:0/3419985400 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f414c003a70 0x7f414c003e80 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f4158009b60 tx=0x7f414c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd499978a0d2bb74 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T13:49:22.160 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:22.151+0000 7f4162ffd700 1 -- 172.21.15.86:0/3419985400 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f415800e6c0 con 0x7f414c003a70 2023-03-06T13:49:22.160 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:22.151+0000 7f4162ffd700 1 -- 172.21.15.86:0/3419985400 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f415800e820 con 0x7f414c003a70 2023-03-06T13:49:22.160 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:22.151+0000 7f4162ffd700 1 -- 172.21.15.86:0/3419985400 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f415800eb90 con 0x7f414c003a70 2023-03-06T13:49:22.160 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:22.151+0000 7f416a922700 1 -- 172.21.15.86:0/3419985400 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f414c003a70 msgr2=0x7f414c003e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:22.160 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:22.151+0000 7f416a922700 1 --2- 172.21.15.86:0/3419985400 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f414c003a70 0x7f414c003e80 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f4158009b60 tx=0x7f414c005880 comp rx=0 tx=0).stop 2023-03-06T13:49:22.161 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:22.151+0000 7f4168ebf700 1 -- 172.21.15.86:0/3419985400 reap_dead start 2023-03-06T13:49:22.161 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:22.151+0000 7f416a922700 1 -- 172.21.15.86:0/3419985400 shutdown_connections 2023-03-06T13:49:22.161 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:22.151+0000 7f416a922700 1 -- 172.21.15.86:0/3419985400 >> 172.21.15.86:0/3419985400 conn(0x7f416406c0d0 msgr2=0x7f41640c2150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T13:49:22.161 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:22.152+0000 7f416a922700 1 -- 172.21.15.86:0/3419985400 shutdown_connections 2023-03-06T13:49:22.161 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:22.152+0000 7f416a922700 1 -- 172.21.15.86:0/3419985400 wait complete. 2023-03-06T13:49:22.161 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:22.153+0000 7f416a922700 1 Processor -- start 2023-03-06T13:49:22.161 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:22.153+0000 7f416a922700 1 -- start start 2023-03-06T13:49:22.163 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:22.153+0000 7f416a922700 1 --2- >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f414c003a70 0x7f41640bf3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:22.163 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:22.153+0000 7f416a922700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f41640c0a60 0x7f416414d250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:22.164 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:22.153+0000 7f416a922700 1 --2- >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f416414d790 0x7f4164140340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:22.164 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:22.153+0000 7f416a922700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f416414eaa0 con 0x7f41640c0a60 2023-03-06T13:49:22.164 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:22.153+0000 7f416a922700 1 -- --> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f416414dc30 con 0x7f414c003a70 2023-03-06T13:49:22.164 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:22.153+0000 7f416a922700 1 -- --> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41640bf920 con 0x7f416414d790 2023-03-06T13:49:22.164 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:22.154+0000 7f41637fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f41640c0a60 0x7f416414d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:22.164 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:22.154+0000 7f41637fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f41640c0a60 0x7f416414d250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:39094/0 (socket says 172.21.15.86:39094) 2023-03-06T13:49:22.164 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:22.154+0000 7f41637fe700 1 -- 172.21.15.86:0/3201543959 learned_addr learned my addr 172.21.15.86:0/3201543959 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-03-06T13:49:22.165 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:22.154+0000 7f4163fff700 1 --2- 172.21.15.86:0/3201543959 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f414c003a70 0x7f41640bf3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:22.165 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:22.154+0000 7f4168ebf700 1 --2- 172.21.15.86:0/3201543959 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f416414d790 0x7f4164140340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:22.165 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:22.154+0000 7f41637fe700 1 -- 172.21.15.86:0/3201543959 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f416414d790 msgr2=0x7f4164140340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:22.165 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:22.154+0000 7f41637fe700 1 --2- 172.21.15.86:0/3201543959 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f416414d790 0x7f4164140340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:22.165 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:22.154+0000 7f41637fe700 1 -- 172.21.15.86:0/3201543959 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f414c003a70 msgr2=0x7f41640bf3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:22.165 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:22.154+0000 7f41637fe700 1 --2- 172.21.15.86:0/3201543959 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f414c003a70 0x7f41640bf3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:22.165 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:22.154+0000 7f41637fe700 1 -- 172.21.15.86:0/3201543959 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41640bdd30 con 0x7f41640c0a60 2023-03-06T13:49:22.166 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:22.154+0000 7f4163fff700 1 --2- 172.21.15.86:0/3201543959 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f414c003a70 0x7f41640bf3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-06T13:49:22.166 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:22.154+0000 7f41637fe700 1 --2- 172.21.15.86:0/3201543959 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f41640c0a60 0x7f416414d250 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f415400eb20 tx=0x7f415400eee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T13:49:22.166 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:22.154+0000 7f4160ff9700 1 -- 172.21.15.86:0/3201543959 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4154005e00 con 0x7f41640c0a60 2023-03-06T13:49:22.166 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:22.154+0000 7f4160ff9700 1 -- 172.21.15.86:0/3201543959 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f415400c760 con 0x7f41640c0a60 2023-03-06T13:49:22.166 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:22.154+0000 7f416a922700 1 -- 172.21.15.86:0/3201543959 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41640bda50 con 0x7f41640c0a60 2023-03-06T13:49:22.166 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:22.154+0000 7f4160ff9700 1 -- 172.21.15.86:0/3201543959 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f415400cb10 con 0x7f41640c0a60 2023-03-06T13:49:22.166 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:22.154+0000 7f416a922700 1 -- 172.21.15.86:0/3201543959 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41640723b0 con 0x7f41640c0a60 2023-03-06T13:49:22.166 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:22.155+0000 7f416a922700 1 -- 172.21.15.86:0/3201543959 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f416404e750 con 0x7f41640c0a60 2023-03-06T13:49:22.167 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:22.155+0000 7f4160ff9700 1 -- 172.21.15.86:0/3201543959 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f415400cc70 con 0x7f41640c0a60 2023-03-06T13:49:22.167 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:22.156+0000 7f4160ff9700 1 --2- 172.21.15.86:0/3201543959 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7f41500682f0 0x7f415006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:22.167 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:22.156+0000 7f4160ff9700 1 -- 172.21.15.86:0/3201543959 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f4154085a50 con 0x7f41640c0a60 2023-03-06T13:49:22.167 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:22.156+0000 7f4163fff700 1 --2- 172.21.15.86:0/3201543959 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7f41500682f0 0x7f415006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:22.167 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:22.156+0000 7f4163fff700 1 --2- 172.21.15.86:0/3201543959 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7f41500682f0 0x7f415006a7a0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f41580090b0 tx=0x7f4158008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T13:49:22.167 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:22.160+0000 7f4160ff9700 1 -- 172.21.15.86:0/3201543959 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f41540522b0 con 0x7f41640c0a60 2023-03-06T13:49:22.340 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:22.338+0000 7f416a922700 1 -- 172.21.15.86:0/3201543959 --> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4164067ba0 con 0x7f41500682f0 2023-03-06T13:49:22.348 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:22.346+0000 7f4160ff9700 1 -- 172.21.15.86:0/3201543959 <== mgr.4101 v2:172.21.15.86:6832/96468 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286503 (secure 0 0 0) 0x7f4164067ba0 con 0x7f41500682f0 2023-03-06T13:49:22.353 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-03-06T13:49:22.354 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:22.349+0000 7f416a922700 1 -- 172.21.15.86:0/3201543959 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7f41500682f0 msgr2=0x7f415006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:22.355 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:22.349+0000 7f416a922700 1 --2- 172.21.15.86:0/3201543959 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7f41500682f0 0x7f415006a7a0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f41580090b0 tx=0x7f4158008030 comp rx=0 tx=0).stop 2023-03-06T13:49:22.355 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:22.349+0000 7f416a922700 1 -- 172.21.15.86:0/3201543959 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f41640c0a60 msgr2=0x7f416414d250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:22.355 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:22.349+0000 7f416a922700 1 --2- 172.21.15.86:0/3201543959 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f41640c0a60 0x7f416414d250 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f415400eb20 tx=0x7f415400eee0 comp rx=0 tx=0).stop 2023-03-06T13:49:22.355 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:22.349+0000 7f416a922700 1 -- 172.21.15.86:0/3201543959 shutdown_connections 2023-03-06T13:49:22.355 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:22.349+0000 7f416a922700 1 --2- 172.21.15.86:0/3201543959 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7f41500682f0 0x7f415006a7a0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:22.355 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:22.349+0000 7f416a922700 1 --2- 172.21.15.86:0/3201543959 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f416414d790 0x7f4164140340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:22.356 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:22.349+0000 7f416a922700 1 --2- 172.21.15.86:0/3201543959 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f414c003a70 0x7f41640bf3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:22.356 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:22.349+0000 7f416a922700 1 --2- 172.21.15.86:0/3201543959 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f41640c0a60 0x7f416414d250 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:22.356 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:22.349+0000 7f416a922700 1 -- 172.21.15.86:0/3201543959 >> 172.21.15.86:0/3201543959 conn(0x7f416406c0d0 msgr2=0x7f416406a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T13:49:22.356 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:22.349+0000 7f416a922700 1 -- 172.21.15.86:0/3201543959 shutdown_connections 2023-03-06T13:49:22.356 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:22.349+0000 7f416a922700 1 -- 172.21.15.86:0/3201543959 wait complete. 2023-03-06T13:49:22.356 INFO:teuthology.orchestra.run.smithi086.stderr:dumped all 2023-03-06T13:49:22.363 INFO:teuthology.orchestra.run.smithi086.stdout:{"pg_ready":true,"pg_map":{"version":27,"stamp":"2023-03-06T13:49:21.838329+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592698,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":66280,"kb_used_data":3112,"kb_used_omap":0,"kb_used_meta":63104,"kb_avail":754908440,"statfs":{"total":773094113280,"available":773026242560,"internally_reserved":0,"allocated":3186688,"data_stored":1902188,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":64618496},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2330,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.129630"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:14.854679+0000","last_change":"2023-03-06T13:49:13.726873+0000","last_active":"2023-03-06T13:49:14.854679+0000","last_peered":"2023-03-06T13:49:14.854679+0000","last_clean":"2023-03-06T13:49:14.854679+0000","last_became_active":"2023-03-06T13:49:13.726628+0000","last_became_peered":"2023-03-06T13:49:13.726628+0000","last_unstale":"2023-03-06T13:49:14.854679+0000","last_undegraded":"2023-03-06T13:49:14.854679+0000","last_fullsized":"2023-03-06T13:49:14.854679+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T19:17:36.354708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:14.858673+0000","last_change":"2023-03-06T13:49:13.721134+0000","last_active":"2023-03-06T13:49:14.858673+0000","last_peered":"2023-03-06T13:49:14.858673+0000","last_clean":"2023-03-06T13:49:14.858673+0000","last_became_active":"2023-03-06T13:49:13.720869+0000","last_became_peered":"2023-03-06T13:49:13.720869+0000","last_unstale":"2023-03-06T13:49:14.858673+0000","last_undegraded":"2023-03-06T13:49:14.858673+0000","last_fullsized":"2023-03-06T13:49:14.858673+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T16:46:29.744316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:14.858551+0000","last_change":"2023-03-06T13:49:13.729489+0000","last_active":"2023-03-06T13:49:14.858551+0000","last_peered":"2023-03-06T13:49:14.858551+0000","last_clean":"2023-03-06T13:49:14.858551+0000","last_became_active":"2023-03-06T13:49:13.729243+0000","last_became_peered":"2023-03-06T13:49:13.729243+0000","last_unstale":"2023-03-06T13:49:14.858551+0000","last_undegraded":"2023-03-06T13:49:14.858551+0000","last_fullsized":"2023-03-06T13:49:14.858551+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T19:08:52.672756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-06T13:49:14.715661+0000","last_change":"2023-03-06T13:49:13.726808+0000","last_active":"2023-03-06T13:49:14.715661+0000","last_peered":"2023-03-06T13:49:14.715661+0000","last_clean":"2023-03-06T13:49:14.715661+0000","last_became_active":"2023-03-06T13:49:13.726503+0000","last_became_peered":"2023-03-06T13:49:13.726503+0000","last_unstale":"2023-03-06T13:49:14.715661+0000","last_undegraded":"2023-03-06T13:49:14.715661+0000","last_fullsized":"2023-03-06T13:49:14.715661+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T18:44:55.549229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:14.851986+0000","last_change":"2023-03-06T13:49:13.725773+0000","last_active":"2023-03-06T13:49:14.851986+0000","last_peered":"2023-03-06T13:49:14.851986+0000","last_clean":"2023-03-06T13:49:14.851986+0000","last_became_active":"2023-03-06T13:49:13.725564+0000","last_became_peered":"2023-03-06T13:49:13.725564+0000","last_unstale":"2023-03-06T13:49:14.851986+0000","last_undegraded":"2023-03-06T13:49:14.851986+0000","last_fullsized":"2023-03-06T13:49:14.851986+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T20:18:58.498628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:14.858392+0000","last_change":"2023-03-06T13:49:13.729753+0000","last_active":"2023-03-06T13:49:14.858392+0000","last_peered":"2023-03-06T13:49:14.858392+0000","last_clean":"2023-03-06T13:49:14.858392+0000","last_became_active":"2023-03-06T13:49:13.729417+0000","last_became_peered":"2023-03-06T13:49:13.729417+0000","last_unstale":"2023-03-06T13:49:14.858392+0000","last_undegraded":"2023-03-06T13:49:14.858392+0000","last_fullsized":"2023-03-06T13:49:14.858392+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T18:31:22.344849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:14.851303+0000","last_change":"2023-03-06T13:49:13.732669+0000","last_active":"2023-03-06T13:49:14.851303+0000","last_peered":"2023-03-06T13:49:14.851303+0000","last_clean":"2023-03-06T13:49:14.851303+0000","last_became_active":"2023-03-06T13:49:13.732195+0000","last_became_peered":"2023-03-06T13:49:13.732195+0000","last_unstale":"2023-03-06T13:49:14.851303+0000","last_undegraded":"2023-03-06T13:49:14.851303+0000","last_fullsized":"2023-03-06T13:49:14.851303+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T19:41:30.016073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:14.858519+0000","last_change":"2023-03-06T13:49:13.731729+0000","last_active":"2023-03-06T13:49:14.858519+0000","last_peered":"2023-03-06T13:49:14.858519+0000","last_clean":"2023-03-06T13:49:14.858519+0000","last_became_active":"2023-03-06T13:49:13.731424+0000","last_became_peered":"2023-03-06T13:49:13.731424+0000","last_unstale":"2023-03-06T13:49:14.858519+0000","last_undegraded":"2023-03-06T13:49:14.858519+0000","last_fullsized":"2023-03-06T13:49:14.858519+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T19:41:30.016073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:14.852082+0000","last_change":"2023-03-06T13:49:13.731091+0000","last_active":"2023-03-06T13:49:14.852082+0000","last_peered":"2023-03-06T13:49:14.852082+0000","last_clean":"2023-03-06T13:49:14.852082+0000","last_became_active":"2023-03-06T13:49:13.730858+0000","last_became_peered":"2023-03-06T13:49:13.730858+0000","last_unstale":"2023-03-06T13:49:14.852082+0000","last_undegraded":"2023-03-06T13:49:14.852082+0000","last_fullsized":"2023-03-06T13:49:14.852082+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T17:11:13.619652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:14.858713+0000","last_change":"2023-03-06T13:49:13.726985+0000","last_active":"2023-03-06T13:49:14.858713+0000","last_peered":"2023-03-06T13:49:14.858713+0000","last_clean":"2023-03-06T13:49:14.858713+0000","last_became_active":"2023-03-06T13:49:13.726697+0000","last_became_peered":"2023-03-06T13:49:13.726697+0000","last_unstale":"2023-03-06T13:49:14.858713+0000","last_undegraded":"2023-03-06T13:49:14.858713+0000","last_fullsized":"2023-03-06T13:49:14.858713+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T22:37:42.599167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:14.858535+0000","last_change":"2023-03-06T13:49:13.735341+0000","last_active":"2023-03-06T13:49:14.858535+0000","last_peered":"2023-03-06T13:49:14.858535+0000","last_clean":"2023-03-06T13:49:14.858535+0000","last_became_active":"2023-03-06T13:49:13.733728+0000","last_became_peered":"2023-03-06T13:49:13.733728+0000","last_unstale":"2023-03-06T13:49:14.858535+0000","last_undegraded":"2023-03-06T13:49:14.858535+0000","last_fullsized":"2023-03-06T13:49:14.858535+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T14:31:12.427709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:14.854621+0000","last_change":"2023-03-06T13:49:13.733654+0000","last_active":"2023-03-06T13:49:14.854621+0000","last_peered":"2023-03-06T13:49:14.854621+0000","last_clean":"2023-03-06T13:49:14.854621+0000","last_became_active":"2023-03-06T13:49:13.733408+0000","last_became_peered":"2023-03-06T13:49:13.733408+0000","last_unstale":"2023-03-06T13:49:14.854621+0000","last_undegraded":"2023-03-06T13:49:14.854621+0000","last_fullsized":"2023-03-06T13:49:14.854621+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T20:23:18.245157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:14.854581+0000","last_change":"2023-03-06T13:49:13.726066+0000","last_active":"2023-03-06T13:49:14.854581+0000","last_peered":"2023-03-06T13:49:14.854581+0000","last_clean":"2023-03-06T13:49:14.854581+0000","last_became_active":"2023-03-06T13:49:13.725767+0000","last_became_peered":"2023-03-06T13:49:13.725767+0000","last_unstale":"2023-03-06T13:49:14.854581+0000","last_undegraded":"2023-03-06T13:49:14.854581+0000","last_fullsized":"2023-03-06T13:49:14.854581+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T16:21:45.003183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:14.858552+0000","last_change":"2023-03-06T13:49:13.721687+0000","last_active":"2023-03-06T13:49:14.858552+0000","last_peered":"2023-03-06T13:49:14.858552+0000","last_clean":"2023-03-06T13:49:14.858552+0000","last_became_active":"2023-03-06T13:49:13.721400+0000","last_became_peered":"2023-03-06T13:49:13.721400+0000","last_unstale":"2023-03-06T13:49:14.858552+0000","last_undegraded":"2023-03-06T13:49:14.858552+0000","last_fullsized":"2023-03-06T13:49:14.858552+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T15:06:01.435712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:14.851340+0000","last_change":"2023-03-06T13:49:13.733193+0000","last_active":"2023-03-06T13:49:14.851340+0000","last_peered":"2023-03-06T13:49:14.851340+0000","last_clean":"2023-03-06T13:49:14.851340+0000","last_became_active":"2023-03-06T13:49:13.732559+0000","last_became_peered":"2023-03-06T13:49:13.732559+0000","last_unstale":"2023-03-06T13:49:14.851340+0000","last_undegraded":"2023-03-06T13:49:14.851340+0000","last_fullsized":"2023-03-06T13:49:14.851340+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T15:06:01.435712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:14.858330+0000","last_change":"2023-03-06T13:49:13.730075+0000","last_active":"2023-03-06T13:49:14.858330+0000","last_peered":"2023-03-06T13:49:14.858330+0000","last_clean":"2023-03-06T13:49:14.858330+0000","last_became_active":"2023-03-06T13:49:13.729158+0000","last_became_peered":"2023-03-06T13:49:13.729158+0000","last_unstale":"2023-03-06T13:49:14.858330+0000","last_undegraded":"2023-03-06T13:49:14.858330+0000","last_fullsized":"2023-03-06T13:49:14.858330+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T19:41:30.016073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:14.852091+0000","last_change":"2023-03-06T13:49:13.731030+0000","last_active":"2023-03-06T13:49:14.852091+0000","last_peered":"2023-03-06T13:49:14.852091+0000","last_clean":"2023-03-06T13:49:14.852091+0000","last_became_active":"2023-03-06T13:49:13.730786+0000","last_became_peered":"2023-03-06T13:49:13.730786+0000","last_unstale":"2023-03-06T13:49:14.852091+0000","last_undegraded":"2023-03-06T13:49:14.852091+0000","last_fullsized":"2023-03-06T13:49:14.852091+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T16:42:39.878112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:14.858591+0000","last_change":"2023-03-06T13:49:13.728942+0000","last_active":"2023-03-06T13:49:14.858591+0000","last_peered":"2023-03-06T13:49:14.858591+0000","last_clean":"2023-03-06T13:49:14.858591+0000","last_became_active":"2023-03-06T13:49:13.727975+0000","last_became_peered":"2023-03-06T13:49:13.727975+0000","last_unstale":"2023-03-06T13:49:14.858591+0000","last_undegraded":"2023-03-06T13:49:14.858591+0000","last_fullsized":"2023-03-06T13:49:14.858591+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T22:37:42.599167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:14.854661+0000","last_change":"2023-03-06T13:49:13.721970+0000","last_active":"2023-03-06T13:49:14.854661+0000","last_peered":"2023-03-06T13:49:14.854661+0000","last_clean":"2023-03-06T13:49:14.854661+0000","last_became_active":"2023-03-06T13:49:13.721722+0000","last_became_peered":"2023-03-06T13:49:13.721722+0000","last_unstale":"2023-03-06T13:49:14.854661+0000","last_undegraded":"2023-03-06T13:49:14.854661+0000","last_fullsized":"2023-03-06T13:49:14.854661+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T19:53:35.686308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:14.858490+0000","last_change":"2023-03-06T13:49:13.732576+0000","last_active":"2023-03-06T13:49:14.858490+0000","last_peered":"2023-03-06T13:49:14.858490+0000","last_clean":"2023-03-06T13:49:14.858490+0000","last_became_active":"2023-03-06T13:49:13.732314+0000","last_became_peered":"2023-03-06T13:49:13.732314+0000","last_unstale":"2023-03-06T13:49:14.858490+0000","last_undegraded":"2023-03-06T13:49:14.858490+0000","last_fullsized":"2023-03-06T13:49:14.858490+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T20:18:58.498628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:14.851382+0000","last_change":"2023-03-06T13:49:13.734115+0000","last_active":"2023-03-06T13:49:14.851382+0000","last_peered":"2023-03-06T13:49:14.851382+0000","last_clean":"2023-03-06T13:49:14.851382+0000","last_became_active":"2023-03-06T13:49:13.733850+0000","last_became_peered":"2023-03-06T13:49:13.733850+0000","last_unstale":"2023-03-06T13:49:14.851382+0000","last_undegraded":"2023-03-06T13:49:14.851382+0000","last_fullsized":"2023-03-06T13:49:14.851382+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T16:46:29.744316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:14.851977+0000","last_change":"2023-03-06T13:49:13.724411+0000","last_active":"2023-03-06T13:49:14.851977+0000","last_peered":"2023-03-06T13:49:14.851977+0000","last_clean":"2023-03-06T13:49:14.851977+0000","last_became_active":"2023-03-06T13:49:13.724151+0000","last_became_peered":"2023-03-06T13:49:13.724151+0000","last_unstale":"2023-03-06T13:49:14.851977+0000","last_undegraded":"2023-03-06T13:49:14.851977+0000","last_fullsized":"2023-03-06T13:49:14.851977+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T19:41:30.016073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:14.852554+0000","last_change":"2023-03-06T13:49:13.727285+0000","last_active":"2023-03-06T13:49:14.852554+0000","last_peered":"2023-03-06T13:49:14.852554+0000","last_clean":"2023-03-06T13:49:14.852554+0000","last_became_active":"2023-03-06T13:49:13.724921+0000","last_became_peered":"2023-03-06T13:49:13.724921+0000","last_unstale":"2023-03-06T13:49:14.852554+0000","last_undegraded":"2023-03-06T13:49:14.852554+0000","last_fullsized":"2023-03-06T13:49:14.852554+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-08T00:56:55.731171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:14.851266+0000","last_change":"2023-03-06T13:49:13.732435+0000","last_active":"2023-03-06T13:49:14.851266+0000","last_peered":"2023-03-06T13:49:14.851266+0000","last_clean":"2023-03-06T13:49:14.851266+0000","last_became_active":"2023-03-06T13:49:13.732118+0000","last_became_peered":"2023-03-06T13:49:13.732118+0000","last_unstale":"2023-03-06T13:49:14.851266+0000","last_undegraded":"2023-03-06T13:49:14.851266+0000","last_fullsized":"2023-03-06T13:49:14.851266+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T22:37:42.599167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-06T13:49:14.714294+0000","last_change":"2023-03-06T13:49:13.722347+0000","last_active":"2023-03-06T13:49:14.714294+0000","last_peered":"2023-03-06T13:49:14.714294+0000","last_clean":"2023-03-06T13:49:14.714294+0000","last_became_active":"2023-03-06T13:49:13.722089+0000","last_became_peered":"2023-03-06T13:49:13.722089+0000","last_unstale":"2023-03-06T13:49:14.714294+0000","last_undegraded":"2023-03-06T13:49:14.714294+0000","last_fullsized":"2023-03-06T13:49:14.714294+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T18:20:43.874725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-06T13:49:14.714475+0000","last_change":"2023-03-06T13:49:13.721459+0000","last_active":"2023-03-06T13:49:14.714475+0000","last_peered":"2023-03-06T13:49:14.714475+0000","last_clean":"2023-03-06T13:49:14.714475+0000","last_became_active":"2023-03-06T13:49:13.721210+0000","last_became_peered":"2023-03-06T13:49:13.721210+0000","last_unstale":"2023-03-06T13:49:14.714475+0000","last_undegraded":"2023-03-06T13:49:14.714475+0000","last_fullsized":"2023-03-06T13:49:14.714475+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T21:46:16.457828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:14.858623+0000","last_change":"2023-03-06T13:49:13.729761+0000","last_active":"2023-03-06T13:49:14.858623+0000","last_peered":"2023-03-06T13:49:14.858623+0000","last_clean":"2023-03-06T13:49:14.858623+0000","last_became_active":"2023-03-06T13:49:13.729301+0000","last_became_peered":"2023-03-06T13:49:13.729301+0000","last_unstale":"2023-03-06T13:49:14.858623+0000","last_undegraded":"2023-03-06T13:49:14.858623+0000","last_fullsized":"2023-03-06T13:49:14.858623+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T16:42:39.878112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"22'1","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:14.858418+0000","last_change":"2023-03-06T13:49:13.328562+0000","last_active":"2023-03-06T13:49:14.858418+0000","last_peered":"2023-03-06T13:49:14.858418+0000","last_clean":"2023-03-06T13:49:14.858418+0000","last_became_active":"2023-03-06T13:49:13.328314+0000","last_became_peered":"2023-03-06T13:49:13.328314+0000","last_unstale":"2023-03-06T13:49:14.858418+0000","last_undegraded":"2023-03-06T13:49:14.858418+0000","last_fullsized":"2023-03-06T13:49:14.858418+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_clean_scrub_stamp":"2023-03-06T13:49:12.303785+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-08T00:39:06.477914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:14.852610+0000","last_change":"2023-03-06T13:49:13.729956+0000","last_active":"2023-03-06T13:49:14.852610+0000","last_peered":"2023-03-06T13:49:14.852610+0000","last_clean":"2023-03-06T13:49:14.852610+0000","last_became_active":"2023-03-06T13:49:13.728115+0000","last_became_peered":"2023-03-06T13:49:13.728115+0000","last_unstale":"2023-03-06T13:49:14.852610+0000","last_undegraded":"2023-03-06T13:49:14.852610+0000","last_fullsized":"2023-03-06T13:49:14.852610+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T22:37:42.599167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-06T13:49:14.714081+0000","last_change":"2023-03-06T13:49:13.330148+0000","last_active":"2023-03-06T13:49:14.714081+0000","last_peered":"2023-03-06T13:49:14.714081+0000","last_clean":"2023-03-06T13:49:14.714081+0000","last_became_active":"2023-03-06T13:49:13.329874+0000","last_became_peered":"2023-03-06T13:49:13.329874+0000","last_unstale":"2023-03-06T13:49:14.714081+0000","last_undegraded":"2023-03-06T13:49:14.714081+0000","last_fullsized":"2023-03-06T13:49:14.714081+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_clean_scrub_stamp":"2023-03-06T13:49:12.303785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T14:43:51.863266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:14.852052+0000","last_change":"2023-03-06T13:49:13.726403+0000","last_active":"2023-03-06T13:49:14.852052+0000","last_peered":"2023-03-06T13:49:14.852052+0000","last_clean":"2023-03-06T13:49:14.852052+0000","last_became_active":"2023-03-06T13:49:13.726155+0000","last_became_peered":"2023-03-06T13:49:13.726155+0000","last_unstale":"2023-03-06T13:49:14.852052+0000","last_undegraded":"2023-03-06T13:49:14.852052+0000","last_fullsized":"2023-03-06T13:49:14.852052+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T18:43:12.631018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:14.852509+0000","last_change":"2023-03-06T13:49:13.333031+0000","last_active":"2023-03-06T13:49:14.852509+0000","last_peered":"2023-03-06T13:49:14.852509+0000","last_clean":"2023-03-06T13:49:14.852509+0000","last_became_active":"2023-03-06T13:49:13.332715+0000","last_became_peered":"2023-03-06T13:49:13.332715+0000","last_unstale":"2023-03-06T13:49:14.852509+0000","last_undegraded":"2023-03-06T13:49:14.852509+0000","last_fullsized":"2023-03-06T13:49:14.852509+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_clean_scrub_stamp":"2023-03-06T13:49:12.303785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T20:52:58.439733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-06T13:49:14.716097+0000","last_change":"2023-03-06T13:49:13.729931+0000","last_active":"2023-03-06T13:49:14.716097+0000","last_peered":"2023-03-06T13:49:14.716097+0000","last_clean":"2023-03-06T13:49:14.716097+0000","last_became_active":"2023-03-06T13:49:13.729657+0000","last_became_peered":"2023-03-06T13:49:13.729657+0000","last_unstale":"2023-03-06T13:49:14.716097+0000","last_undegraded":"2023-03-06T13:49:14.716097+0000","last_fullsized":"2023-03-06T13:49:14.716097+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T23:59:53.012700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:14.852101+0000","last_change":"2023-03-06T13:49:13.335979+0000","last_active":"2023-03-06T13:49:14.852101+0000","last_peered":"2023-03-06T13:49:14.852101+0000","last_clean":"2023-03-06T13:49:14.852101+0000","last_became_active":"2023-03-06T13:49:13.335701+0000","last_became_peered":"2023-03-06T13:49:13.335701+0000","last_unstale":"2023-03-06T13:49:14.852101+0000","last_undegraded":"2023-03-06T13:49:14.852101+0000","last_fullsized":"2023-03-06T13:49:14.852101+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_clean_scrub_stamp":"2023-03-06T13:49:12.303785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T19:17:35.350354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:14.852498+0000","last_change":"2023-03-06T13:49:13.721193+0000","last_active":"2023-03-06T13:49:14.852498+0000","last_peered":"2023-03-06T13:49:14.852498+0000","last_clean":"2023-03-06T13:49:14.852498+0000","last_became_active":"2023-03-06T13:49:13.720968+0000","last_became_peered":"2023-03-06T13:49:13.720968+0000","last_unstale":"2023-03-06T13:49:14.852498+0000","last_undegraded":"2023-03-06T13:49:14.852498+0000","last_fullsized":"2023-03-06T13:49:14.852498+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T16:42:39.878112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:14.858703+0000","last_change":"2023-03-06T13:49:13.336210+0000","last_active":"2023-03-06T13:49:14.858703+0000","last_peered":"2023-03-06T13:49:14.858703+0000","last_clean":"2023-03-06T13:49:14.858703+0000","last_became_active":"2023-03-06T13:49:13.335895+0000","last_became_peered":"2023-03-06T13:49:13.335895+0000","last_unstale":"2023-03-06T13:49:14.858703+0000","last_undegraded":"2023-03-06T13:49:14.858703+0000","last_fullsized":"2023-03-06T13:49:14.858703+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_clean_scrub_stamp":"2023-03-06T13:49:12.303785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T19:53:34.681954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:14.852539+0000","last_change":"2023-03-06T13:49:13.727461+0000","last_active":"2023-03-06T13:49:14.852539+0000","last_peered":"2023-03-06T13:49:14.852539+0000","last_clean":"2023-03-06T13:49:14.852539+0000","last_became_active":"2023-03-06T13:49:13.726691+0000","last_became_peered":"2023-03-06T13:49:13.726691+0000","last_unstale":"2023-03-06T13:49:14.852539+0000","last_undegraded":"2023-03-06T13:49:14.852539+0000","last_fullsized":"2023-03-06T13:49:14.852539+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-08T01:30:43.884806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"22'3","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:14.851418+0000","last_change":"2023-03-06T13:49:13.337258+0000","last_active":"2023-03-06T13:49:14.851418+0000","last_peered":"2023-03-06T13:49:14.851418+0000","last_clean":"2023-03-06T13:49:14.851418+0000","last_became_active":"2023-03-06T13:49:13.336956+0000","last_became_peered":"2023-03-06T13:49:13.336956+0000","last_unstale":"2023-03-06T13:49:14.851418+0000","last_undegraded":"2023-03-06T13:49:14.851418+0000","last_fullsized":"2023-03-06T13:49:14.851418+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_clean_scrub_stamp":"2023-03-06T13:49:12.303785+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T20:23:17.240803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-06T13:49:14.714418+0000","last_change":"2023-03-06T13:49:13.720024+0000","last_active":"2023-03-06T13:49:14.714418+0000","last_peered":"2023-03-06T13:49:14.714418+0000","last_clean":"2023-03-06T13:49:14.714418+0000","last_became_active":"2023-03-06T13:49:13.719745+0000","last_became_peered":"2023-03-06T13:49:13.719745+0000","last_unstale":"2023-03-06T13:49:14.714418+0000","last_undegraded":"2023-03-06T13:49:14.714418+0000","last_fullsized":"2023-03-06T13:49:14.714418+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T20:22:12.811857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"22'6","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:14.858510+0000","last_change":"2023-03-06T13:49:13.332863+0000","last_active":"2023-03-06T13:49:14.858510+0000","last_peered":"2023-03-06T13:49:14.858510+0000","last_clean":"2023-03-06T13:49:14.858510+0000","last_became_active":"2023-03-06T13:49:13.332579+0000","last_became_peered":"2023-03-06T13:49:13.332579+0000","last_unstale":"2023-03-06T13:49:14.858510+0000","last_undegraded":"2023-03-06T13:49:14.858510+0000","last_fullsized":"2023-03-06T13:49:14.858510+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_clean_scrub_stamp":"2023-03-06T13:49:12.303785+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T18:49:50.763848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1548,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:14.858468+0000","last_change":"2023-03-06T13:49:13.728503+0000","last_active":"2023-03-06T13:49:14.858468+0000","last_peered":"2023-03-06T13:49:14.858468+0000","last_clean":"2023-03-06T13:49:14.858468+0000","last_became_active":"2023-03-06T13:49:13.727740+0000","last_became_peered":"2023-03-06T13:49:13.727740+0000","last_unstale":"2023-03-06T13:49:14.858468+0000","last_undegraded":"2023-03-06T13:49:14.858468+0000","last_fullsized":"2023-03-06T13:49:14.858468+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-08T00:56:55.731171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.13","version":"22'2","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:14.851360+0000","last_change":"2023-03-06T13:49:13.336773+0000","last_active":"2023-03-06T13:49:14.851360+0000","last_peered":"2023-03-06T13:49:14.851360+0000","last_clean":"2023-03-06T13:49:14.851360+0000","last_became_active":"2023-03-06T13:49:13.336321+0000","last_became_peered":"2023-03-06T13:49:13.336321+0000","last_unstale":"2023-03-06T13:49:14.851360+0000","last_undegraded":"2023-03-06T13:49:14.851360+0000","last_fullsized":"2023-03-06T13:49:14.851360+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_clean_scrub_stamp":"2023-03-06T13:49:12.303785+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-08T01:45:44.452690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:14.852600+0000","last_change":"2023-03-06T13:49:13.725662+0000","last_active":"2023-03-06T13:49:14.852600+0000","last_peered":"2023-03-06T13:49:14.852600+0000","last_clean":"2023-03-06T13:49:14.852600+0000","last_became_active":"2023-03-06T13:49:13.725029+0000","last_became_peered":"2023-03-06T13:49:13.725029+0000","last_unstale":"2023-03-06T13:49:14.852600+0000","last_undegraded":"2023-03-06T13:49:14.852600+0000","last_fullsized":"2023-03-06T13:49:14.852600+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T19:41:30.016073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:14.851967+0000","last_change":"2023-03-06T13:49:13.332902+0000","last_active":"2023-03-06T13:49:14.851967+0000","last_peered":"2023-03-06T13:49:14.851967+0000","last_clean":"2023-03-06T13:49:14.851967+0000","last_became_active":"2023-03-06T13:49:13.332641+0000","last_became_peered":"2023-03-06T13:49:13.332641+0000","last_unstale":"2023-03-06T13:49:14.851967+0000","last_undegraded":"2023-03-06T13:49:14.851967+0000","last_fullsized":"2023-03-06T13:49:14.851967+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_clean_scrub_stamp":"2023-03-06T13:49:12.303785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T19:26:48.272662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:14.858634+0000","last_change":"2023-03-06T13:49:13.729557+0000","last_active":"2023-03-06T13:49:14.858634+0000","last_peered":"2023-03-06T13:49:14.858634+0000","last_clean":"2023-03-06T13:49:14.858634+0000","last_became_active":"2023-03-06T13:49:13.728917+0000","last_became_peered":"2023-03-06T13:49:13.728917+0000","last_unstale":"2023-03-06T13:49:14.858634+0000","last_undegraded":"2023-03-06T13:49:14.858634+0000","last_fullsized":"2023-03-06T13:49:14.858634+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T18:43:12.631018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:14.851321+0000","last_change":"2023-03-06T13:49:13.337738+0000","last_active":"2023-03-06T13:49:14.851321+0000","last_peered":"2023-03-06T13:49:14.851321+0000","last_clean":"2023-03-06T13:49:14.851321+0000","last_became_active":"2023-03-06T13:49:13.337441+0000","last_became_peered":"2023-03-06T13:49:13.337441+0000","last_unstale":"2023-03-06T13:49:14.851321+0000","last_undegraded":"2023-03-06T13:49:14.851321+0000","last_fullsized":"2023-03-06T13:49:14.851321+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_clean_scrub_stamp":"2023-03-06T13:49:12.303785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T19:17:35.350354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:14.852033+0000","last_change":"2023-03-06T13:49:13.725893+0000","last_active":"2023-03-06T13:49:14.852033+0000","last_peered":"2023-03-06T13:49:14.852033+0000","last_clean":"2023-03-06T13:49:14.852033+0000","last_became_active":"2023-03-06T13:49:13.725632+0000","last_became_peered":"2023-03-06T13:49:13.725632+0000","last_unstale":"2023-03-06T13:49:14.852033+0000","last_undegraded":"2023-03-06T13:49:14.852033+0000","last_fullsized":"2023-03-06T13:49:14.852033+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-08T00:56:55.731171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"22'8","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-06T13:49:14.715336+0000","last_change":"2023-03-06T13:49:13.325572+0000","last_active":"2023-03-06T13:49:14.715336+0000","last_peered":"2023-03-06T13:49:14.715336+0000","last_clean":"2023-03-06T13:49:14.715336+0000","last_became_active":"2023-03-06T13:49:13.325252+0000","last_became_peered":"2023-03-06T13:49:13.325252+0000","last_unstale":"2023-03-06T13:49:14.715336+0000","last_undegraded":"2023-03-06T13:49:14.715336+0000","last_fullsized":"2023-03-06T13:49:14.715336+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_clean_scrub_stamp":"2023-03-06T13:49:12.303785+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T18:49:50.763848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:14.852649+0000","last_change":"2023-03-06T13:49:13.730932+0000","last_active":"2023-03-06T13:49:14.852649+0000","last_peered":"2023-03-06T13:49:14.852649+0000","last_clean":"2023-03-06T13:49:14.852649+0000","last_became_active":"2023-03-06T13:49:13.728504+0000","last_became_peered":"2023-03-06T13:49:13.728504+0000","last_unstale":"2023-03-06T13:49:14.852649+0000","last_undegraded":"2023-03-06T13:49:14.852649+0000","last_fullsized":"2023-03-06T13:49:14.852649+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T16:46:29.744316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"22'1","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:14.851500+0000","last_change":"2023-03-06T13:49:13.336765+0000","last_active":"2023-03-06T13:49:14.851500+0000","last_peered":"2023-03-06T13:49:14.851500+0000","last_clean":"2023-03-06T13:49:14.851500+0000","last_became_active":"2023-03-06T13:49:13.336364+0000","last_became_peered":"2023-03-06T13:49:13.336364+0000","last_unstale":"2023-03-06T13:49:14.851500+0000","last_undegraded":"2023-03-06T13:49:14.851500+0000","last_fullsized":"2023-03-06T13:49:14.851500+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_clean_scrub_stamp":"2023-03-06T13:49:12.303785+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T23:59:52.008346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:14.858534+0000","last_change":"2023-03-06T13:49:13.725154+0000","last_active":"2023-03-06T13:49:14.858534+0000","last_peered":"2023-03-06T13:49:14.858534+0000","last_clean":"2023-03-06T13:49:14.858534+0000","last_became_active":"2023-03-06T13:49:13.724853+0000","last_became_peered":"2023-03-06T13:49:13.724853+0000","last_unstale":"2023-03-06T13:49:14.858534+0000","last_undegraded":"2023-03-06T13:49:14.858534+0000","last_fullsized":"2023-03-06T13:49:14.858534+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T23:04:29.575987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"22'2","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:14.851477+0000","last_change":"2023-03-06T13:49:13.336914+0000","last_active":"2023-03-06T13:49:14.851477+0000","last_peered":"2023-03-06T13:49:14.851477+0000","last_clean":"2023-03-06T13:49:14.851477+0000","last_became_active":"2023-03-06T13:49:13.336552+0000","last_became_peered":"2023-03-06T13:49:13.336552+0000","last_unstale":"2023-03-06T13:49:14.851477+0000","last_undegraded":"2023-03-06T13:49:14.851477+0000","last_fullsized":"2023-03-06T13:49:14.851477+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_clean_scrub_stamp":"2023-03-06T13:49:12.303785+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T16:21:43.998829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:14.858346+0000","last_change":"2023-03-06T13:49:13.730794+0000","last_active":"2023-03-06T13:49:14.858346+0000","last_peered":"2023-03-06T13:49:14.858346+0000","last_clean":"2023-03-06T13:49:14.858346+0000","last_became_active":"2023-03-06T13:49:13.730504+0000","last_became_peered":"2023-03-06T13:49:13.730504+0000","last_unstale":"2023-03-06T13:49:14.858346+0000","last_undegraded":"2023-03-06T13:49:14.858346+0000","last_fullsized":"2023-03-06T13:49:14.858346+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T23:04:29.575987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"22'1","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:14.851452+0000","last_change":"2023-03-06T13:49:13.335019+0000","last_active":"2023-03-06T13:49:14.851452+0000","last_peered":"2023-03-06T13:49:14.851452+0000","last_clean":"2023-03-06T13:49:14.851452+0000","last_became_active":"2023-03-06T13:49:13.334748+0000","last_became_peered":"2023-03-06T13:49:13.334748+0000","last_unstale":"2023-03-06T13:49:14.851452+0000","last_undegraded":"2023-03-06T13:49:14.851452+0000","last_fullsized":"2023-03-06T13:49:14.851452+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_clean_scrub_stamp":"2023-03-06T13:49:12.303785+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T18:44:54.544875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-06T13:49:14.715551+0000","last_change":"2023-03-06T13:49:13.722448+0000","last_active":"2023-03-06T13:49:14.715551+0000","last_peered":"2023-03-06T13:49:14.715551+0000","last_clean":"2023-03-06T13:49:14.715551+0000","last_became_active":"2023-03-06T13:49:13.719433+0000","last_became_peered":"2023-03-06T13:49:13.719433+0000","last_unstale":"2023-03-06T13:49:14.715551+0000","last_undegraded":"2023-03-06T13:49:14.715551+0000","last_fullsized":"2023-03-06T13:49:14.715551+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T19:17:36.354708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:14.858597+0000","last_change":"2023-03-06T13:49:13.329213+0000","last_active":"2023-03-06T13:49:14.858597+0000","last_peered":"2023-03-06T13:49:14.858597+0000","last_clean":"2023-03-06T13:49:14.858597+0000","last_became_active":"2023-03-06T13:49:13.328881+0000","last_became_peered":"2023-03-06T13:49:13.328881+0000","last_unstale":"2023-03-06T13:49:14.858597+0000","last_undegraded":"2023-03-06T13:49:14.858597+0000","last_fullsized":"2023-03-06T13:49:14.858597+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_clean_scrub_stamp":"2023-03-06T13:49:12.303785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-08T01:45:44.452690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:14.852023+0000","last_change":"2023-03-06T13:49:13.722967+0000","last_active":"2023-03-06T13:49:14.852023+0000","last_peered":"2023-03-06T13:49:14.852023+0000","last_clean":"2023-03-06T13:49:14.852023+0000","last_became_active":"2023-03-06T13:49:13.722502+0000","last_became_peered":"2023-03-06T13:49:13.722502+0000","last_unstale":"2023-03-06T13:49:14.852023+0000","last_undegraded":"2023-03-06T13:49:14.852023+0000","last_fullsized":"2023-03-06T13:49:14.852023+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T16:46:29.744316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"22'2","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:14.852577+0000","last_change":"2023-03-06T13:49:13.334295+0000","last_active":"2023-03-06T13:49:14.852577+0000","last_peered":"2023-03-06T13:49:14.852577+0000","last_clean":"2023-03-06T13:49:14.852577+0000","last_became_active":"2023-03-06T13:49:13.334029+0000","last_became_peered":"2023-03-06T13:49:13.334029+0000","last_unstale":"2023-03-06T13:49:14.852577+0000","last_undegraded":"2023-03-06T13:49:14.852577+0000","last_fullsized":"2023-03-06T13:49:14.852577+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_clean_scrub_stamp":"2023-03-06T13:49:12.303785+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T17:43:02.141473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:14.858523+0000","last_change":"2023-03-06T13:49:13.735942+0000","last_active":"2023-03-06T13:49:14.858523+0000","last_peered":"2023-03-06T13:49:14.858523+0000","last_clean":"2023-03-06T13:49:14.858523+0000","last_became_active":"2023-03-06T13:49:13.735605+0000","last_became_peered":"2023-03-06T13:49:13.735605+0000","last_unstale":"2023-03-06T13:49:14.858523+0000","last_undegraded":"2023-03-06T13:49:14.858523+0000","last_fullsized":"2023-03-06T13:49:14.858523+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-08T01:35:08.480796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-06T13:49:14.715543+0000","last_change":"2023-03-06T13:49:13.334902+0000","last_active":"2023-03-06T13:49:14.715543+0000","last_peered":"2023-03-06T13:49:14.715543+0000","last_clean":"2023-03-06T13:49:14.715543+0000","last_became_active":"2023-03-06T13:49:13.334117+0000","last_became_peered":"2023-03-06T13:49:13.334117+0000","last_unstale":"2023-03-06T13:49:14.715543+0000","last_undegraded":"2023-03-06T13:49:14.715543+0000","last_fullsized":"2023-03-06T13:49:14.715543+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_clean_scrub_stamp":"2023-03-06T13:49:12.303785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T19:15:21.274175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:14.858564+0000","last_change":"2023-03-06T13:49:13.735438+0000","last_active":"2023-03-06T13:49:14.858564+0000","last_peered":"2023-03-06T13:49:14.858564+0000","last_clean":"2023-03-06T13:49:14.858564+0000","last_became_active":"2023-03-06T13:49:13.734124+0000","last_became_peered":"2023-03-06T13:49:13.734124+0000","last_unstale":"2023-03-06T13:49:14.858564+0000","last_undegraded":"2023-03-06T13:49:14.858564+0000","last_fullsized":"2023-03-06T13:49:14.858564+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T21:05:03.457340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:14.858367+0000","last_change":"2023-03-06T13:49:13.331505+0000","last_active":"2023-03-06T13:49:14.858367+0000","last_peered":"2023-03-06T13:49:14.858367+0000","last_clean":"2023-03-06T13:49:14.858367+0000","last_became_active":"2023-03-06T13:49:13.331213+0000","last_became_peered":"2023-03-06T13:49:13.331213+0000","last_unstale":"2023-03-06T13:49:14.858367+0000","last_undegraded":"2023-03-06T13:49:14.858367+0000","last_fullsized":"2023-03-06T13:49:14.858367+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_clean_scrub_stamp":"2023-03-06T13:49:12.303785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T14:43:51.863266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:14.858577+0000","last_change":"2023-03-06T13:49:13.731378+0000","last_active":"2023-03-06T13:49:14.858577+0000","last_peered":"2023-03-06T13:49:14.858577+0000","last_clean":"2023-03-06T13:49:14.858577+0000","last_became_active":"2023-03-06T13:49:13.729527+0000","last_became_peered":"2023-03-06T13:49:13.729527+0000","last_unstale":"2023-03-06T13:49:14.858577+0000","last_undegraded":"2023-03-06T13:49:14.858577+0000","last_fullsized":"2023-03-06T13:49:14.858577+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T17:11:13.619652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:14.852486+0000","last_change":"2023-03-06T13:49:13.333554+0000","last_active":"2023-03-06T13:49:14.852486+0000","last_peered":"2023-03-06T13:49:14.852486+0000","last_clean":"2023-03-06T13:49:14.852486+0000","last_became_active":"2023-03-06T13:49:13.333290+0000","last_became_peered":"2023-03-06T13:49:13.333290+0000","last_unstale":"2023-03-06T13:49:14.852486+0000","last_undegraded":"2023-03-06T13:49:14.852486+0000","last_fullsized":"2023-03-06T13:49:14.852486+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_clean_scrub_stamp":"2023-03-06T13:49:12.303785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T19:53:34.681954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-06T13:49:14.714385+0000","last_change":"2023-03-06T13:49:13.727168+0000","last_active":"2023-03-06T13:49:14.714385+0000","last_peered":"2023-03-06T13:49:14.714385+0000","last_clean":"2023-03-06T13:49:14.714385+0000","last_became_active":"2023-03-06T13:49:13.726711+0000","last_became_peered":"2023-03-06T13:49:13.726711+0000","last_unstale":"2023-03-06T13:49:14.714385+0000","last_undegraded":"2023-03-06T13:49:14.714385+0000","last_fullsized":"2023-03-06T13:49:14.714385+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T19:41:30.016073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:13.714161+0000","last_change":"2023-03-06T13:49:08.699699+0000","last_active":"2023-03-06T13:49:13.714161+0000","last_peered":"2023-03-06T13:49:13.714161+0000","last_clean":"2023-03-06T13:49:13.714161+0000","last_became_active":"2023-03-06T13:49:08.699396+0000","last_became_peered":"2023-03-06T13:49:08.699396+0000","last_unstale":"2023-03-06T13:49:13.714161+0000","last_undegraded":"2023-03-06T13:49:13.714161+0000","last_fullsized":"2023-03-06T13:49:13.714161+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:07.278421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:07.278421+0000","last_clean_scrub_stamp":"2023-03-06T13:49:07.278421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-08T01:22:20.301600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:14.858647+0000","last_change":"2023-03-06T13:49:13.336126+0000","last_active":"2023-03-06T13:49:14.858647+0000","last_peered":"2023-03-06T13:49:14.858647+0000","last_clean":"2023-03-06T13:49:14.858647+0000","last_became_active":"2023-03-06T13:49:13.335530+0000","last_became_peered":"2023-03-06T13:49:13.335530+0000","last_unstale":"2023-03-06T13:49:14.858647+0000","last_undegraded":"2023-03-06T13:49:14.858647+0000","last_fullsized":"2023-03-06T13:49:14.858647+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_clean_scrub_stamp":"2023-03-06T13:49:12.303785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T16:21:43.998829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-06T13:49:14.714365+0000","last_change":"2023-03-06T13:49:13.727824+0000","last_active":"2023-03-06T13:49:14.714365+0000","last_peered":"2023-03-06T13:49:14.714365+0000","last_clean":"2023-03-06T13:49:14.714365+0000","last_became_active":"2023-03-06T13:49:13.727472+0000","last_became_peered":"2023-03-06T13:49:13.727472+0000","last_unstale":"2023-03-06T13:49:14.714365+0000","last_undegraded":"2023-03-06T13:49:14.714365+0000","last_fullsized":"2023-03-06T13:49:14.714365+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T22:37:42.599167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:13.713932+0000","last_change":"2023-03-06T13:49:08.306975+0000","last_active":"2023-03-06T13:49:13.713932+0000","last_peered":"2023-03-06T13:49:13.713932+0000","last_clean":"2023-03-06T13:49:13.713932+0000","last_became_active":"2023-03-06T13:49:08.306669+0000","last_became_peered":"2023-03-06T13:49:08.306669+0000","last_unstale":"2023-03-06T13:49:13.713932+0000","last_undegraded":"2023-03-06T13:49:13.713932+0000","last_fullsized":"2023-03-06T13:49:13.713932+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:07.278421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:07.278421+0000","last_clean_scrub_stamp":"2023-03-06T13:49:07.278421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T19:54:04.557386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:14.858479+0000","last_change":"2023-03-06T13:49:13.327601+0000","last_active":"2023-03-06T13:49:14.858479+0000","last_peered":"2023-03-06T13:49:14.858479+0000","last_clean":"2023-03-06T13:49:14.858479+0000","last_became_active":"2023-03-06T13:49:13.327317+0000","last_became_peered":"2023-03-06T13:49:13.327317+0000","last_unstale":"2023-03-06T13:49:14.858479+0000","last_undegraded":"2023-03-06T13:49:14.858479+0000","last_fullsized":"2023-03-06T13:49:14.858479+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_clean_scrub_stamp":"2023-03-06T13:49:12.303785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T19:15:21.274175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-06T13:49:14.714429+0000","last_change":"2023-03-06T13:49:13.728830+0000","last_active":"2023-03-06T13:49:14.714429+0000","last_peered":"2023-03-06T13:49:14.714429+0000","last_clean":"2023-03-06T13:49:14.714429+0000","last_became_active":"2023-03-06T13:49:13.726036+0000","last_became_peered":"2023-03-06T13:49:13.726036+0000","last_unstale":"2023-03-06T13:49:14.714429+0000","last_undegraded":"2023-03-06T13:49:14.714429+0000","last_fullsized":"2023-03-06T13:49:14.714429+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T15:06:01.435712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:13.709976+0000","last_change":"2023-03-06T13:49:08.314061+0000","last_active":"2023-03-06T13:49:13.709976+0000","last_peered":"2023-03-06T13:49:13.709976+0000","last_clean":"2023-03-06T13:49:13.709976+0000","last_became_active":"2023-03-06T13:49:08.313713+0000","last_became_peered":"2023-03-06T13:49:08.313713+0000","last_unstale":"2023-03-06T13:49:13.709976+0000","last_undegraded":"2023-03-06T13:49:13.709976+0000","last_fullsized":"2023-03-06T13:49:13.709976+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:07.278421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:07.278421+0000","last_clean_scrub_stamp":"2023-03-06T13:49:07.278421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T15:29:35.587025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-06T13:49:14.713974+0000","last_change":"2023-03-06T13:49:13.331494+0000","last_active":"2023-03-06T13:49:14.713974+0000","last_peered":"2023-03-06T13:49:14.713974+0000","last_clean":"2023-03-06T13:49:14.713974+0000","last_became_active":"2023-03-06T13:49:13.331229+0000","last_became_peered":"2023-03-06T13:49:13.331229+0000","last_unstale":"2023-03-06T13:49:14.713974+0000","last_undegraded":"2023-03-06T13:49:14.713974+0000","last_fullsized":"2023-03-06T13:49:14.713974+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_clean_scrub_stamp":"2023-03-06T13:49:12.303785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T19:53:34.681954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-06T13:49:14.714342+0000","last_change":"2023-03-06T13:49:13.727756+0000","last_active":"2023-03-06T13:49:14.714342+0000","last_peered":"2023-03-06T13:49:14.714342+0000","last_clean":"2023-03-06T13:49:14.714342+0000","last_became_active":"2023-03-06T13:49:13.727509+0000","last_became_peered":"2023-03-06T13:49:13.727509+0000","last_unstale":"2023-03-06T13:49:14.714342+0000","last_undegraded":"2023-03-06T13:49:14.714342+0000","last_fullsized":"2023-03-06T13:49:14.714342+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T16:46:29.744316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:13.713270+0000","last_change":"2023-03-06T13:49:08.307053+0000","last_active":"2023-03-06T13:49:13.713270+0000","last_peered":"2023-03-06T13:49:13.713270+0000","last_clean":"2023-03-06T13:49:13.713270+0000","last_became_active":"2023-03-06T13:49:08.306737+0000","last_became_peered":"2023-03-06T13:49:08.306737+0000","last_unstale":"2023-03-06T13:49:13.713270+0000","last_undegraded":"2023-03-06T13:49:13.713270+0000","last_fullsized":"2023-03-06T13:49:13.713270+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:07.278421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:07.278421+0000","last_clean_scrub_stamp":"2023-03-06T13:49:07.278421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T21:59:33.265276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":167,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:13.723777+0000","last_change":"2023-03-06T13:49:01.912106+0000","last_active":"2023-03-06T13:49:13.723777+0000","last_peered":"2023-03-06T13:49:13.723777+0000","last_clean":"2023-03-06T13:49:13.723777+0000","last_became_active":"2023-03-06T13:49:01.911157+0000","last_became_peered":"2023-03-06T13:49:01.911157+0000","last_unstale":"2023-03-06T13:49:13.723777+0000","last_undegraded":"2023-03-06T13:49:13.723777+0000","last_fullsized":"2023-03-06T13:49:13.723777+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:00.859533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:00.859533+0000","last_clean_scrub_stamp":"2023-03-06T13:49:00.859533+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T21:39:16.753876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:14.852566+0000","last_change":"2023-03-06T13:49:13.335291+0000","last_active":"2023-03-06T13:49:14.852566+0000","last_peered":"2023-03-06T13:49:14.852566+0000","last_clean":"2023-03-06T13:49:14.852566+0000","last_became_active":"2023-03-06T13:49:13.334976+0000","last_became_peered":"2023-03-06T13:49:13.334976+0000","last_unstale":"2023-03-06T13:49:14.852566+0000","last_undegraded":"2023-03-06T13:49:14.852566+0000","last_fullsized":"2023-03-06T13:49:14.852566+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_clean_scrub_stamp":"2023-03-06T13:49:12.303785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-08T01:45:44.452690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-06T13:49:14.715835+0000","last_change":"2023-03-06T13:49:13.730668+0000","last_active":"2023-03-06T13:49:14.715835+0000","last_peered":"2023-03-06T13:49:14.715835+0000","last_clean":"2023-03-06T13:49:14.715835+0000","last_became_active":"2023-03-06T13:49:13.730191+0000","last_became_peered":"2023-03-06T13:49:13.730191+0000","last_unstale":"2023-03-06T13:49:14.715835+0000","last_undegraded":"2023-03-06T13:49:14.715835+0000","last_fullsized":"2023-03-06T13:49:14.715835+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T20:23:18.245157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:13.724229+0000","last_change":"2023-03-06T13:49:08.307071+0000","last_active":"2023-03-06T13:49:13.724229+0000","last_peered":"2023-03-06T13:49:13.724229+0000","last_clean":"2023-03-06T13:49:13.724229+0000","last_became_active":"2023-03-06T13:49:08.306682+0000","last_became_peered":"2023-03-06T13:49:08.306682+0000","last_unstale":"2023-03-06T13:49:13.724229+0000","last_undegraded":"2023-03-06T13:49:13.724229+0000","last_fullsized":"2023-03-06T13:49:13.724229+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:07.278421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:07.278421+0000","last_clean_scrub_stamp":"2023-03-06T13:49:07.278421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T19:54:04.557386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:14.851950+0000","last_change":"2023-03-06T13:49:13.331989+0000","last_active":"2023-03-06T13:49:14.851950+0000","last_peered":"2023-03-06T13:49:14.851950+0000","last_clean":"2023-03-06T13:49:14.851950+0000","last_became_active":"2023-03-06T13:49:13.331679+0000","last_became_peered":"2023-03-06T13:49:13.331679+0000","last_unstale":"2023-03-06T13:49:14.851950+0000","last_undegraded":"2023-03-06T13:49:14.851950+0000","last_fullsized":"2023-03-06T13:49:14.851950+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_clean_scrub_stamp":"2023-03-06T13:49:12.303785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T19:53:34.681954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:14.852073+0000","last_change":"2023-03-06T13:49:13.722056+0000","last_active":"2023-03-06T13:49:14.852073+0000","last_peered":"2023-03-06T13:49:14.852073+0000","last_clean":"2023-03-06T13:49:14.852073+0000","last_became_active":"2023-03-06T13:49:13.721792+0000","last_became_peered":"2023-03-06T13:49:13.721792+0000","last_unstale":"2023-03-06T13:49:14.852073+0000","last_undegraded":"2023-03-06T13:49:14.852073+0000","last_fullsized":"2023-03-06T13:49:14.852073+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T22:37:42.599167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:13.726401+0000","last_change":"2023-03-06T13:49:08.699801+0000","last_active":"2023-03-06T13:49:13.726401+0000","last_peered":"2023-03-06T13:49:13.726401+0000","last_clean":"2023-03-06T13:49:13.726401+0000","last_became_active":"2023-03-06T13:49:08.699514+0000","last_became_peered":"2023-03-06T13:49:08.699514+0000","last_unstale":"2023-03-06T13:49:13.726401+0000","last_undegraded":"2023-03-06T13:49:13.726401+0000","last_fullsized":"2023-03-06T13:49:13.726401+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:07.278421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:07.278421+0000","last_clean_scrub_stamp":"2023-03-06T13:49:07.278421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-08T00:50:49.893386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-06T13:49:14.714510+0000","last_change":"2023-03-06T13:49:13.332420+0000","last_active":"2023-03-06T13:49:14.714510+0000","last_peered":"2023-03-06T13:49:14.714510+0000","last_clean":"2023-03-06T13:49:14.714510+0000","last_became_active":"2023-03-06T13:49:13.332115+0000","last_became_peered":"2023-03-06T13:49:13.332115+0000","last_unstale":"2023-03-06T13:49:14.714510+0000","last_undegraded":"2023-03-06T13:49:14.714510+0000","last_fullsized":"2023-03-06T13:49:14.714510+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_clean_scrub_stamp":"2023-03-06T13:49:12.303785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T20:52:58.439733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:14.851999+0000","last_change":"2023-03-06T13:49:13.728080+0000","last_active":"2023-03-06T13:49:14.851999+0000","last_peered":"2023-03-06T13:49:14.851999+0000","last_clean":"2023-03-06T13:49:14.851999+0000","last_became_active":"2023-03-06T13:49:13.727805+0000","last_became_peered":"2023-03-06T13:49:13.727805+0000","last_unstale":"2023-03-06T13:49:14.851999+0000","last_undegraded":"2023-03-06T13:49:14.851999+0000","last_fullsized":"2023-03-06T13:49:14.851999+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-08T01:30:43.884806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"22'2","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:14.852634+0000","last_change":"2023-03-06T13:49:13.333399+0000","last_active":"2023-03-06T13:49:14.852634+0000","last_peered":"2023-03-06T13:49:14.852634+0000","last_clean":"2023-03-06T13:49:14.852634+0000","last_became_active":"2023-03-06T13:49:13.333083+0000","last_became_peered":"2023-03-06T13:49:13.333083+0000","last_unstale":"2023-03-06T13:49:14.852634+0000","last_undegraded":"2023-03-06T13:49:14.852634+0000","last_fullsized":"2023-03-06T13:49:14.852634+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_clean_scrub_stamp":"2023-03-06T13:49:12.303785+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T19:26:48.272662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:13.714043+0000","last_change":"2023-03-06T13:49:08.303113+0000","last_active":"2023-03-06T13:49:13.714043+0000","last_peered":"2023-03-06T13:49:13.714043+0000","last_clean":"2023-03-06T13:49:13.714043+0000","last_became_active":"2023-03-06T13:49:08.302803+0000","last_became_peered":"2023-03-06T13:49:08.302803+0000","last_unstale":"2023-03-06T13:49:13.714043+0000","last_undegraded":"2023-03-06T13:49:13.714043+0000","last_fullsized":"2023-03-06T13:49:13.714043+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:07.278421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:07.278421+0000","last_clean_scrub_stamp":"2023-03-06T13:49:07.278421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T15:29:35.587025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:14.852472+0000","last_change":"2023-03-06T13:49:13.726793+0000","last_active":"2023-03-06T13:49:14.852472+0000","last_peered":"2023-03-06T13:49:14.852472+0000","last_clean":"2023-03-06T13:49:14.852472+0000","last_became_active":"2023-03-06T13:49:13.726528+0000","last_became_peered":"2023-03-06T13:49:13.726528+0000","last_unstale":"2023-03-06T13:49:14.852472+0000","last_undegraded":"2023-03-06T13:49:14.852472+0000","last_fullsized":"2023-03-06T13:49:14.852472+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T17:11:13.619652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:13.714479+0000","last_change":"2023-03-06T13:49:08.302357+0000","last_active":"2023-03-06T13:49:13.714479+0000","last_peered":"2023-03-06T13:49:13.714479+0000","last_clean":"2023-03-06T13:49:13.714479+0000","last_became_active":"2023-03-06T13:49:08.302038+0000","last_became_peered":"2023-03-06T13:49:08.302038+0000","last_unstale":"2023-03-06T13:49:13.714479+0000","last_undegraded":"2023-03-06T13:49:13.714479+0000","last_fullsized":"2023-03-06T13:49:13.714479+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:07.278421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:07.278421+0000","last_clean_scrub_stamp":"2023-03-06T13:49:07.278421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-08T01:22:20.301600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"23'1","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-06T13:49:15.099591+0000","last_change":"2023-03-06T13:49:13.327179+0000","last_active":"2023-03-06T13:49:15.099591+0000","last_peered":"2023-03-06T13:49:15.099591+0000","last_clean":"2023-03-06T13:49:15.099591+0000","last_became_active":"2023-03-06T13:49:13.326813+0000","last_became_peered":"2023-03-06T13:49:13.326813+0000","last_unstale":"2023-03-06T13:49:15.099591+0000","last_undegraded":"2023-03-06T13:49:15.099591+0000","last_fullsized":"2023-03-06T13:49:15.099591+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_clean_scrub_stamp":"2023-03-06T13:49:12.303785+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-08T01:45:44.452690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:14.858356+0000","last_change":"2023-03-06T13:49:13.733789+0000","last_active":"2023-03-06T13:49:14.858356+0000","last_peered":"2023-03-06T13:49:14.858356+0000","last_clean":"2023-03-06T13:49:14.858356+0000","last_became_active":"2023-03-06T13:49:13.733499+0000","last_became_peered":"2023-03-06T13:49:13.733499+0000","last_unstale":"2023-03-06T13:49:14.858356+0000","last_undegraded":"2023-03-06T13:49:14.858356+0000","last_fullsized":"2023-03-06T13:49:14.858356+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-08T00:51:17.885729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"22'1","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:14.852011+0000","last_change":"2023-03-06T13:49:13.330776+0000","last_active":"2023-03-06T13:49:14.852011+0000","last_peered":"2023-03-06T13:49:14.852011+0000","last_clean":"2023-03-06T13:49:14.852011+0000","last_became_active":"2023-03-06T13:49:13.330380+0000","last_became_peered":"2023-03-06T13:49:13.330380+0000","last_unstale":"2023-03-06T13:49:14.852011+0000","last_undegraded":"2023-03-06T13:49:14.852011+0000","last_fullsized":"2023-03-06T13:49:14.852011+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_clean_scrub_stamp":"2023-03-06T13:49:12.303785+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T16:21:43.998829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:14.854643+0000","last_change":"2023-03-06T13:49:13.721742+0000","last_active":"2023-03-06T13:49:14.854643+0000","last_peered":"2023-03-06T13:49:14.854643+0000","last_clean":"2023-03-06T13:49:14.854643+0000","last_became_active":"2023-03-06T13:49:13.721486+0000","last_became_peered":"2023-03-06T13:49:13.721486+0000","last_unstale":"2023-03-06T13:49:14.854643+0000","last_undegraded":"2023-03-06T13:49:14.854643+0000","last_fullsized":"2023-03-06T13:49:14.854643+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T19:26:49.277016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"22'2","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:14.858581+0000","last_change":"2023-03-06T13:49:13.335557+0000","last_active":"2023-03-06T13:49:14.858581+0000","last_peered":"2023-03-06T13:49:14.858581+0000","last_clean":"2023-03-06T13:49:14.858581+0000","last_became_active":"2023-03-06T13:49:13.335187+0000","last_became_peered":"2023-03-06T13:49:13.335187+0000","last_unstale":"2023-03-06T13:49:14.858581+0000","last_undegraded":"2023-03-06T13:49:14.858581+0000","last_fullsized":"2023-03-06T13:49:14.858581+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_clean_scrub_stamp":"2023-03-06T13:49:12.303785+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T20:23:17.240803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:14.858456+0000","last_change":"2023-03-06T13:49:13.735885+0000","last_active":"2023-03-06T13:49:14.858456+0000","last_peered":"2023-03-06T13:49:14.858456+0000","last_clean":"2023-03-06T13:49:14.858456+0000","last_became_active":"2023-03-06T13:49:13.735406+0000","last_became_peered":"2023-03-06T13:49:13.735406+0000","last_unstale":"2023-03-06T13:49:14.858456+0000","last_undegraded":"2023-03-06T13:49:14.858456+0000","last_fullsized":"2023-03-06T13:49:14.858456+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T20:35:34.805878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"22'2","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:14.858660+0000","last_change":"2023-03-06T13:49:13.331444+0000","last_active":"2023-03-06T13:49:14.858660+0000","last_peered":"2023-03-06T13:49:14.858660+0000","last_clean":"2023-03-06T13:49:14.858660+0000","last_became_active":"2023-03-06T13:49:13.331144+0000","last_became_peered":"2023-03-06T13:49:13.331144+0000","last_unstale":"2023-03-06T13:49:14.858660+0000","last_undegraded":"2023-03-06T13:49:14.858660+0000","last_fullsized":"2023-03-06T13:49:14.858660+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_clean_scrub_stamp":"2023-03-06T13:49:12.303785+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T19:17:35.350354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:14.858442+0000","last_change":"2023-03-06T13:49:13.736068+0000","last_active":"2023-03-06T13:49:14.858442+0000","last_peered":"2023-03-06T13:49:14.858442+0000","last_clean":"2023-03-06T13:49:14.858442+0000","last_became_active":"2023-03-06T13:49:13.735570+0000","last_became_peered":"2023-03-06T13:49:13.735570+0000","last_unstale":"2023-03-06T13:49:14.858442+0000","last_undegraded":"2023-03-06T13:49:14.858442+0000","last_fullsized":"2023-03-06T13:49:14.858442+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T20:03:32.232238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"22'1","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:14.852622+0000","last_change":"2023-03-06T13:49:13.328915+0000","last_active":"2023-03-06T13:49:14.852622+0000","last_peered":"2023-03-06T13:49:14.852622+0000","last_clean":"2023-03-06T13:49:14.852622+0000","last_became_active":"2023-03-06T13:49:13.328550+0000","last_became_peered":"2023-03-06T13:49:13.328550+0000","last_unstale":"2023-03-06T13:49:14.852622+0000","last_undegraded":"2023-03-06T13:49:14.852622+0000","last_fullsized":"2023-03-06T13:49:14.852622+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_clean_scrub_stamp":"2023-03-06T13:49:12.303785+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T14:43:51.863266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:14.852529+0000","last_change":"2023-03-06T13:49:13.727624+0000","last_active":"2023-03-06T13:49:14.852529+0000","last_peered":"2023-03-06T13:49:14.852529+0000","last_clean":"2023-03-06T13:49:14.852529+0000","last_became_active":"2023-03-06T13:49:13.727000+0000","last_became_peered":"2023-03-06T13:49:13.727000+0000","last_unstale":"2023-03-06T13:49:14.852529+0000","last_undegraded":"2023-03-06T13:49:14.852529+0000","last_fullsized":"2023-03-06T13:49:14.852529+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T15:06:01.435712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"22'4","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:14.852112+0000","last_change":"2023-03-06T13:49:13.334970+0000","last_active":"2023-03-06T13:49:14.852112+0000","last_peered":"2023-03-06T13:49:14.852112+0000","last_clean":"2023-03-06T13:49:14.852112+0000","last_became_active":"2023-03-06T13:49:13.334697+0000","last_became_peered":"2023-03-06T13:49:13.334697+0000","last_unstale":"2023-03-06T13:49:14.852112+0000","last_undegraded":"2023-03-06T13:49:14.852112+0000","last_fullsized":"2023-03-06T13:49:14.852112+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_clean_scrub_stamp":"2023-03-06T13:49:12.303785+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T20:23:17.240803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":566,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:14.858313+0000","last_change":"2023-03-06T13:49:13.728290+0000","last_active":"2023-03-06T13:49:14.858313+0000","last_peered":"2023-03-06T13:49:14.858313+0000","last_clean":"2023-03-06T13:49:14.858313+0000","last_became_active":"2023-03-06T13:49:13.727708+0000","last_became_peered":"2023-03-06T13:49:13.727708+0000","last_unstale":"2023-03-06T13:49:14.858313+0000","last_undegraded":"2023-03-06T13:49:14.858313+0000","last_fullsized":"2023-03-06T13:49:14.858313+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T16:42:39.878112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-06T13:49:14.715385+0000","last_change":"2023-03-06T13:49:13.723965+0000","last_active":"2023-03-06T13:49:14.715385+0000","last_peered":"2023-03-06T13:49:14.715385+0000","last_clean":"2023-03-06T13:49:14.715385+0000","last_became_active":"2023-03-06T13:49:13.723661+0000","last_became_peered":"2023-03-06T13:49:13.723661+0000","last_unstale":"2023-03-06T13:49:14.715385+0000","last_undegraded":"2023-03-06T13:49:14.715385+0000","last_fullsized":"2023-03-06T13:49:14.715385+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T23:31:39.512892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:14.852519+0000","last_change":"2023-03-06T13:49:13.731877+0000","last_active":"2023-03-06T13:49:14.852519+0000","last_peered":"2023-03-06T13:49:14.852519+0000","last_clean":"2023-03-06T13:49:14.852519+0000","last_became_active":"2023-03-06T13:49:13.728168+0000","last_became_peered":"2023-03-06T13:49:13.728168+0000","last_unstale":"2023-03-06T13:49:14.852519+0000","last_undegraded":"2023-03-06T13:49:14.852519+0000","last_fullsized":"2023-03-06T13:49:14.852519+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T18:43:12.631018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:14.858405+0000","last_change":"2023-03-06T13:49:13.730062+0000","last_active":"2023-03-06T13:49:14.858405+0000","last_peered":"2023-03-06T13:49:14.858405+0000","last_clean":"2023-03-06T13:49:14.858405+0000","last_became_active":"2023-03-06T13:49:13.729782+0000","last_became_peered":"2023-03-06T13:49:13.729782+0000","last_unstale":"2023-03-06T13:49:14.858405+0000","last_undegraded":"2023-03-06T13:49:14.858405+0000","last_fullsized":"2023-03-06T13:49:14.858405+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-08T01:30:43.884806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:14.852589+0000","last_change":"2023-03-06T13:49:13.725113+0000","last_active":"2023-03-06T13:49:14.852589+0000","last_peered":"2023-03-06T13:49:14.852589+0000","last_clean":"2023-03-06T13:49:14.852589+0000","last_became_active":"2023-03-06T13:49:13.724824+0000","last_became_peered":"2023-03-06T13:49:13.724824+0000","last_unstale":"2023-03-06T13:49:14.852589+0000","last_undegraded":"2023-03-06T13:49:14.852589+0000","last_fullsized":"2023-03-06T13:49:14.852589+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T20:18:58.498628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-06T13:49:14.714309+0000","last_change":"2023-03-06T13:49:13.724393+0000","last_active":"2023-03-06T13:49:14.714309+0000","last_peered":"2023-03-06T13:49:14.714309+0000","last_clean":"2023-03-06T13:49:14.714309+0000","last_became_active":"2023-03-06T13:49:13.724134+0000","last_became_peered":"2023-03-06T13:49:13.724134+0000","last_unstale":"2023-03-06T13:49:14.714309+0000","last_undegraded":"2023-03-06T13:49:14.714309+0000","last_fullsized":"2023-03-06T13:49:14.714309+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T23:04:29.575987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2330,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574856,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9108,"kb_used_data":844,"kb_used_omap":0,"kb_used_meta":8256,"kb_avail":94362732,"statfs":{"total":96636764160,"available":96627437568,"internally_reserved":0,"allocated":864256,"data_stored":681731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8454144},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57699999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.503}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.43099999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48599999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67900000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67000000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65200000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574856,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7988,"kb_used_data":236,"kb_used_omap":0,"kb_used_meta":7744,"kb_avail":94363852,"statfs":{"total":96636764160,"available":96628584448,"internally_reserved":0,"allocated":241664,"data_stored":89599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7929856},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39700000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47199999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.4740000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.577}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45800000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41799999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54700000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574856,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8052,"kb_used_data":236,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363788,"statfs":{"total":96636764160,"available":96628518912,"internally_reserved":0,"allocated":241664,"data_stored":89599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32200000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28299999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42999999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.496}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54000000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.439}]}]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9084,"kb_used_data":820,"kb_used_omap":0,"kb_used_meta":8256,"kb_avail":94362756,"statfs":{"total":96636764160,"available":96627462144,"internally_reserved":0,"allocated":839680,"data_stored":680533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8454144},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.376}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.314}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26000000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45200000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44600000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58499999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42099999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574856,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7924,"kb_used_data":236,"kb_used_omap":0,"kb_used_meta":7680,"kb_avail":94363916,"statfs":{"total":96636764160,"available":96628649984,"internally_reserved":0,"allocated":241664,"data_stored":89599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7864320},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.262}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64700000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3320000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76000000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72999999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":5.2000000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":5.2910000000000004}]}]},{"osd":3,"up_from":13,"seq":55834574856,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8056,"kb_used_data":240,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363784,"statfs":{"total":96636764160,"available":96628514816,"internally_reserved":0,"allocated":245760,"data_stored":89689,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.159}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80200000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":11.061999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.024}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":11.031000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0960000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8072,"kb_used_data":256,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363768,"statfs":{"total":96636764160,"available":96628498432,"internally_reserved":0,"allocated":262144,"data_stored":91203,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65800000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53000000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.432}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.503}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59099999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.62}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64700000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574856,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7996,"kb_used_data":244,"kb_used_omap":0,"kb_used_meta":7744,"kb_avail":94363844,"statfs":{"total":96636764160,"available":96628576256,"internally_reserved":0,"allocated":249856,"data_stored":90235,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7929856},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55100000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48399999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.436}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61699999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41799999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36299999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39800000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-03-06T13:49:22.370 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-03-06T13:49:22.523 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:22.521+0000 7fb17f12b700 1 Processor -- start 2023-03-06T13:49:22.523 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:22.521+0000 7fb17f12b700 1 -- start start 2023-03-06T13:49:22.528 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:22.521+0000 7fb17f12b700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fb17806ea90 0x7fb17814f0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:22.528 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:22.521+0000 7fb17f12b700 1 --2- >> v2:172.21.15.202:3300/0 conn(0x7fb17814f600 0x7fb178159a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:22.529 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:22.521+0000 7fb17f12b700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb178153340 con 0x7fb178149420 2023-03-06T13:49:22.529 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:22.521+0000 7fb17f12b700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1781497f0 con 0x7fb17806ea90 2023-03-06T13:49:22.529 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:22.521+0000 7fb17f12b700 1 -- --> v2:172.21.15.202:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb178152750 con 0x7fb17814f600 2023-03-06T13:49:22.529 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:22.521+0000 7fb177fff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fb17806ea90 0x7fb17814f0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:22.530 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:22.521+0000 7fb17cec7700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7fb178149420 0x7fb1780c2860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:49248/0 (socket says 172.21.15.86:49248) 2023-03-06T13:49:22.530 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:22.521+0000 7fb17cec7700 1 -- 172.21.15.86:0/117976319 learned_addr learned my addr 172.21.15.86:0/117976319 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-03-06T13:49:22.530 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:22.522+0000 7fb17d6c8700 1 --2- 172.21.15.86:0/117976319 >> v2:172.21.15.202:3300/0 conn(0x7fb17814f600 0x7fb178159a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:22.530 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:22.522+0000 7fb177fff700 1 -- 172.21.15.86:0/117976319 >> v2:172.21.15.202:3300/0 conn(0x7fb17814f600 msgr2=0x7fb178159a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T13:49:22.531 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:22.522+0000 7fb177fff700 1 --2- 172.21.15.86:0/117976319 >> v2:172.21.15.202:3300/0 conn(0x7fb17814f600 0x7fb178159a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:22.531 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:22.522+0000 7fb177fff700 1 -- 172.21.15.86:0/117976319 >> v1:172.21.15.86:6789/0 conn(0x7fb178149420 legacy=0x7fb1780c2860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:22.531 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:22.522+0000 7fb177fff700 1 -- 172.21.15.86:0/117976319 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb178152a10 con 0x7fb17806ea90 2023-03-06T13:49:22.531 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:22.522+0000 7fb1777fe700 1 -- 172.21.15.86:0/117976319 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1264283245 0 0) 0x7fb178153340 con 0x7fb178149420 2023-03-06T13:49:22.532 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:22.522+0000 7fb177fff700 1 --2- 172.21.15.86:0/117976319 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb17806ea90 0x7fb17814f0c0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fb178067df0 tx=0x7fb164009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89c4d5f50c6490ae server_cookie=0 in_seq=0 out_seq=0 2023-03-06T13:49:22.532 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:22.522+0000 7fb1777fe700 1 -- 172.21.15.86:0/117976319 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb164011830 con 0x7fb17806ea90 2023-03-06T13:49:22.532 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:22.522+0000 7fb1777fe700 1 -- 172.21.15.86:0/117976319 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb164011990 con 0x7fb17806ea90 2023-03-06T13:49:22.533 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:22.522+0000 7fb1777fe700 1 -- 172.21.15.86:0/117976319 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb164011d20 con 0x7fb17806ea90 2023-03-06T13:49:22.533 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:22.522+0000 7fb17f12b700 1 -- 172.21.15.86:0/117976319 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb17806ea90 msgr2=0x7fb17814f0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:22.533 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:22.522+0000 7fb17f12b700 1 --2- 172.21.15.86:0/117976319 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb17806ea90 0x7fb17814f0c0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fb178067df0 tx=0x7fb164009b20 comp rx=0 tx=0).stop 2023-03-06T13:49:22.533 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:22.523+0000 7fb17f12b700 1 -- 172.21.15.86:0/117976319 shutdown_connections 2023-03-06T13:49:22.533 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:22.523+0000 7fb17f12b700 1 --2- 172.21.15.86:0/117976319 >> v2:172.21.15.202:3300/0 conn(0x7fb17814f600 0x7fb178159a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:22.534 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:22.523+0000 7fb17f12b700 1 --2- 172.21.15.86:0/117976319 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb17806ea90 0x7fb17814f0c0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:22.534 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:22.523+0000 7fb17f12b700 1 -- 172.21.15.86:0/117976319 >> 172.21.15.86:0/117976319 conn(0x7fb17806c0d0 msgr2=0x7fb1780c2150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T13:49:22.534 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:22.523+0000 7fb17f12b700 1 -- 172.21.15.86:0/117976319 shutdown_connections 2023-03-06T13:49:22.534 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:22.523+0000 7fb17f12b700 1 -- 172.21.15.86:0/117976319 wait complete. 2023-03-06T13:49:22.534 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:22.524+0000 7fb17f12b700 1 Processor -- start 2023-03-06T13:49:22.534 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:22.524+0000 7fb17f12b700 1 -- start start 2023-03-06T13:49:22.534 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:22.524+0000 7fb17f12b700 1 --2- >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7fb17806ea90 0x7fb17806a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:22.535 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:22.524+0000 7fb17f12b700 1 --2- >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fb178149420 0x7fb17814b390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:22.535 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:22.524+0000 7fb17f12b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb17814f600 0x7fb1781484c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:22.535 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:22.524+0000 7fb17f12b700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb17806ab40 con 0x7fb17814f600 2023-03-06T13:49:22.535 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:22.524+0000 7fb17f12b700 1 -- --> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1781e8cc0 con 0x7fb17806ea90 2023-03-06T13:49:22.535 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:22.524+0000 7fb17f12b700 1 -- --> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1781e8fa0 con 0x7fb178149420 2023-03-06T13:49:22.535 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:22.525+0000 7fb17d6c8700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb17814f600 0x7fb1781484c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:22.535 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:22.525+0000 7fb17d6c8700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb17814f600 0x7fb1781484c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:39108/0 (socket says 172.21.15.86:39108) 2023-03-06T13:49:22.535 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:22.525+0000 7fb17d6c8700 1 -- 172.21.15.86:0/563849870 learned_addr learned my addr 172.21.15.86:0/563849870 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-03-06T13:49:22.536 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:22.525+0000 7fb177fff700 1 --2- 172.21.15.86:0/563849870 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fb178149420 0x7fb17814b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:22.536 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:22.525+0000 7fb17cec7700 1 --2- 172.21.15.86:0/563849870 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7fb17806ea90 0x7fb17806a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:22.536 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:22.525+0000 7fb17d6c8700 1 -- 172.21.15.86:0/563849870 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fb178149420 msgr2=0x7fb17814b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:22.536 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:22.525+0000 7fb17d6c8700 1 --2- 172.21.15.86:0/563849870 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fb178149420 0x7fb17814b390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:22.536 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:22.525+0000 7fb17d6c8700 1 -- 172.21.15.86:0/563849870 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7fb17806ea90 msgr2=0x7fb17806a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:22.536 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:22.525+0000 7fb17d6c8700 1 --2- 172.21.15.86:0/563849870 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7fb17806ea90 0x7fb17806a600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:22.536 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:22.525+0000 7fb17d6c8700 1 -- 172.21.15.86:0/563849870 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1640094a0 con 0x7fb17814f600 2023-03-06T13:49:22.537 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:22.525+0000 7fb17cec7700 1 --2- 172.21.15.86:0/563849870 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7fb17806ea90 0x7fb17806a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-06T13:49:22.537 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:22.525+0000 7fb177fff700 1 --2- 172.21.15.86:0/563849870 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fb178149420 0x7fb17814b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-06T13:49:22.537 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:22.525+0000 7fb17d6c8700 1 --2- 172.21.15.86:0/563849870 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb17814f600 0x7fb1781484c0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fb170007e40 tx=0x7fb17000e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T13:49:22.537 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:22.525+0000 7fb1757fa700 1 -- 172.21.15.86:0/563849870 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb17000eea0 con 0x7fb17814f600 2023-03-06T13:49:22.537 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:22.525+0000 7fb1757fa700 1 -- 172.21.15.86:0/563849870 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb170014420 con 0x7fb17814f600 2023-03-06T13:49:22.537 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:22.525+0000 7fb17f12b700 1 -- 172.21.15.86:0/563849870 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb178152fd0 con 0x7fb17814f600 2023-03-06T13:49:22.537 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:22.525+0000 7fb1757fa700 1 -- 172.21.15.86:0/563849870 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1700147b0 con 0x7fb17814f600 2023-03-06T13:49:22.538 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:22.525+0000 7fb17f12b700 1 -- 172.21.15.86:0/563849870 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb178152cf0 con 0x7fb17814f600 2023-03-06T13:49:22.538 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:22.526+0000 7fb17f12b700 1 -- 172.21.15.86:0/563849870 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb17806e610 con 0x7fb17814f600 2023-03-06T13:49:22.538 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:22.527+0000 7fb1757fa700 1 -- 172.21.15.86:0/563849870 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fb170012050 con 0x7fb17814f600 2023-03-06T13:49:22.539 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:22.527+0000 7fb1757fa700 1 --2- 172.21.15.86:0/563849870 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7fb15c0682f0 0x7fb15c06a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:22.539 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:22.527+0000 7fb1757fa700 1 -- 172.21.15.86:0/563849870 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb1700872d0 con 0x7fb17814f600 2023-03-06T13:49:22.539 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:22.527+0000 7fb17cec7700 1 --2- 172.21.15.86:0/563849870 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7fb15c0682f0 0x7fb15c06a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:22.539 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:22.528+0000 7fb17cec7700 1 --2- 172.21.15.86:0/563849870 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7fb15c0682f0 0x7fb15c06a7a0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fb16c000f60 tx=0x7fb16c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T13:49:22.539 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:22.531+0000 7fb1757fa700 1 -- 172.21.15.86:0/563849870 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fb170053ac0 con 0x7fb17814f600 2023-03-06T13:49:22.709 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:22.707+0000 7fb17f12b700 1 -- 172.21.15.86:0/563849870 --> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb17804e750 con 0x7fb15c0682f0 2023-03-06T13:49:22.717 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:22.715+0000 7fb1757fa700 1 -- 172.21.15.86:0/563849870 <== mgr.4101 v2:172.21.15.86:6832/96468 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286503 (secure 0 0 0) 0x7fb17804e750 con 0x7fb15c0682f0 2023-03-06T13:49:22.720 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-03-06T13:49:22.721 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:22.718+0000 7fb17f12b700 1 -- 172.21.15.86:0/563849870 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7fb15c0682f0 msgr2=0x7fb15c06a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:22.722 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:22.718+0000 7fb17f12b700 1 --2- 172.21.15.86:0/563849870 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7fb15c0682f0 0x7fb15c06a7a0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fb16c000f60 tx=0x7fb16c009040 comp rx=0 tx=0).stop 2023-03-06T13:49:22.722 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:22.718+0000 7fb17f12b700 1 -- 172.21.15.86:0/563849870 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb17814f600 msgr2=0x7fb1781484c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:22.722 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:22.718+0000 7fb17f12b700 1 --2- 172.21.15.86:0/563849870 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb17814f600 0x7fb1781484c0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fb170007e40 tx=0x7fb17000e3c0 comp rx=0 tx=0).stop 2023-03-06T13:49:22.722 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:22.718+0000 7fb17f12b700 1 -- 172.21.15.86:0/563849870 shutdown_connections 2023-03-06T13:49:22.722 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:22.718+0000 7fb17f12b700 1 --2- 172.21.15.86:0/563849870 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7fb15c0682f0 0x7fb15c06a7a0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:22.722 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:22.718+0000 7fb17f12b700 1 --2- 172.21.15.86:0/563849870 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb17814f600 0x7fb1781484c0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:22.723 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:22.718+0000 7fb17f12b700 1 --2- 172.21.15.86:0/563849870 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7fb17806ea90 0x7fb17806a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:22.723 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:22.718+0000 7fb17f12b700 1 --2- 172.21.15.86:0/563849870 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fb178149420 0x7fb17814b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:22.723 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:22.718+0000 7fb17f12b700 1 -- 172.21.15.86:0/563849870 >> 172.21.15.86:0/563849870 conn(0x7fb17806c0d0 msgr2=0x7fb178151a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T13:49:22.723 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:22.718+0000 7fb17f12b700 1 -- 172.21.15.86:0/563849870 shutdown_connections 2023-03-06T13:49:22.723 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:22.718+0000 7fb17f12b700 1 -- 172.21.15.86:0/563849870 wait complete. 2023-03-06T13:49:22.723 INFO:teuthology.orchestra.run.smithi086.stderr:dumped all 2023-03-06T13:49:22.732 INFO:teuthology.orchestra.run.smithi086.stdout:{"pg_ready":true,"pg_map":{"version":27,"stamp":"2023-03-06T13:49:21.838329+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592698,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":66280,"kb_used_data":3112,"kb_used_omap":0,"kb_used_meta":63104,"kb_avail":754908440,"statfs":{"total":773094113280,"available":773026242560,"internally_reserved":0,"allocated":3186688,"data_stored":1902188,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":64618496},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2330,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.129630"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:14.854679+0000","last_change":"2023-03-06T13:49:13.726873+0000","last_active":"2023-03-06T13:49:14.854679+0000","last_peered":"2023-03-06T13:49:14.854679+0000","last_clean":"2023-03-06T13:49:14.854679+0000","last_became_active":"2023-03-06T13:49:13.726628+0000","last_became_peered":"2023-03-06T13:49:13.726628+0000","last_unstale":"2023-03-06T13:49:14.854679+0000","last_undegraded":"2023-03-06T13:49:14.854679+0000","last_fullsized":"2023-03-06T13:49:14.854679+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T19:17:36.354708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:14.858673+0000","last_change":"2023-03-06T13:49:13.721134+0000","last_active":"2023-03-06T13:49:14.858673+0000","last_peered":"2023-03-06T13:49:14.858673+0000","last_clean":"2023-03-06T13:49:14.858673+0000","last_became_active":"2023-03-06T13:49:13.720869+0000","last_became_peered":"2023-03-06T13:49:13.720869+0000","last_unstale":"2023-03-06T13:49:14.858673+0000","last_undegraded":"2023-03-06T13:49:14.858673+0000","last_fullsized":"2023-03-06T13:49:14.858673+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T16:46:29.744316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:14.858551+0000","last_change":"2023-03-06T13:49:13.729489+0000","last_active":"2023-03-06T13:49:14.858551+0000","last_peered":"2023-03-06T13:49:14.858551+0000","last_clean":"2023-03-06T13:49:14.858551+0000","last_became_active":"2023-03-06T13:49:13.729243+0000","last_became_peered":"2023-03-06T13:49:13.729243+0000","last_unstale":"2023-03-06T13:49:14.858551+0000","last_undegraded":"2023-03-06T13:49:14.858551+0000","last_fullsized":"2023-03-06T13:49:14.858551+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T19:08:52.672756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-06T13:49:14.715661+0000","last_change":"2023-03-06T13:49:13.726808+0000","last_active":"2023-03-06T13:49:14.715661+0000","last_peered":"2023-03-06T13:49:14.715661+0000","last_clean":"2023-03-06T13:49:14.715661+0000","last_became_active":"2023-03-06T13:49:13.726503+0000","last_became_peered":"2023-03-06T13:49:13.726503+0000","last_unstale":"2023-03-06T13:49:14.715661+0000","last_undegraded":"2023-03-06T13:49:14.715661+0000","last_fullsized":"2023-03-06T13:49:14.715661+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T18:44:55.549229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:14.851986+0000","last_change":"2023-03-06T13:49:13.725773+0000","last_active":"2023-03-06T13:49:14.851986+0000","last_peered":"2023-03-06T13:49:14.851986+0000","last_clean":"2023-03-06T13:49:14.851986+0000","last_became_active":"2023-03-06T13:49:13.725564+0000","last_became_peered":"2023-03-06T13:49:13.725564+0000","last_unstale":"2023-03-06T13:49:14.851986+0000","last_undegraded":"2023-03-06T13:49:14.851986+0000","last_fullsized":"2023-03-06T13:49:14.851986+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T20:18:58.498628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:14.858392+0000","last_change":"2023-03-06T13:49:13.729753+0000","last_active":"2023-03-06T13:49:14.858392+0000","last_peered":"2023-03-06T13:49:14.858392+0000","last_clean":"2023-03-06T13:49:14.858392+0000","last_became_active":"2023-03-06T13:49:13.729417+0000","last_became_peered":"2023-03-06T13:49:13.729417+0000","last_unstale":"2023-03-06T13:49:14.858392+0000","last_undegraded":"2023-03-06T13:49:14.858392+0000","last_fullsized":"2023-03-06T13:49:14.858392+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T18:31:22.344849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:14.851303+0000","last_change":"2023-03-06T13:49:13.732669+0000","last_active":"2023-03-06T13:49:14.851303+0000","last_peered":"2023-03-06T13:49:14.851303+0000","last_clean":"2023-03-06T13:49:14.851303+0000","last_became_active":"2023-03-06T13:49:13.732195+0000","last_became_peered":"2023-03-06T13:49:13.732195+0000","last_unstale":"2023-03-06T13:49:14.851303+0000","last_undegraded":"2023-03-06T13:49:14.851303+0000","last_fullsized":"2023-03-06T13:49:14.851303+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T19:41:30.016073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:14.858519+0000","last_change":"2023-03-06T13:49:13.731729+0000","last_active":"2023-03-06T13:49:14.858519+0000","last_peered":"2023-03-06T13:49:14.858519+0000","last_clean":"2023-03-06T13:49:14.858519+0000","last_became_active":"2023-03-06T13:49:13.731424+0000","last_became_peered":"2023-03-06T13:49:13.731424+0000","last_unstale":"2023-03-06T13:49:14.858519+0000","last_undegraded":"2023-03-06T13:49:14.858519+0000","last_fullsized":"2023-03-06T13:49:14.858519+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T19:41:30.016073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:14.852082+0000","last_change":"2023-03-06T13:49:13.731091+0000","last_active":"2023-03-06T13:49:14.852082+0000","last_peered":"2023-03-06T13:49:14.852082+0000","last_clean":"2023-03-06T13:49:14.852082+0000","last_became_active":"2023-03-06T13:49:13.730858+0000","last_became_peered":"2023-03-06T13:49:13.730858+0000","last_unstale":"2023-03-06T13:49:14.852082+0000","last_undegraded":"2023-03-06T13:49:14.852082+0000","last_fullsized":"2023-03-06T13:49:14.852082+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T17:11:13.619652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:14.858713+0000","last_change":"2023-03-06T13:49:13.726985+0000","last_active":"2023-03-06T13:49:14.858713+0000","last_peered":"2023-03-06T13:49:14.858713+0000","last_clean":"2023-03-06T13:49:14.858713+0000","last_became_active":"2023-03-06T13:49:13.726697+0000","last_became_peered":"2023-03-06T13:49:13.726697+0000","last_unstale":"2023-03-06T13:49:14.858713+0000","last_undegraded":"2023-03-06T13:49:14.858713+0000","last_fullsized":"2023-03-06T13:49:14.858713+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T22:37:42.599167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:14.858535+0000","last_change":"2023-03-06T13:49:13.735341+0000","last_active":"2023-03-06T13:49:14.858535+0000","last_peered":"2023-03-06T13:49:14.858535+0000","last_clean":"2023-03-06T13:49:14.858535+0000","last_became_active":"2023-03-06T13:49:13.733728+0000","last_became_peered":"2023-03-06T13:49:13.733728+0000","last_unstale":"2023-03-06T13:49:14.858535+0000","last_undegraded":"2023-03-06T13:49:14.858535+0000","last_fullsized":"2023-03-06T13:49:14.858535+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T14:31:12.427709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:14.854621+0000","last_change":"2023-03-06T13:49:13.733654+0000","last_active":"2023-03-06T13:49:14.854621+0000","last_peered":"2023-03-06T13:49:14.854621+0000","last_clean":"2023-03-06T13:49:14.854621+0000","last_became_active":"2023-03-06T13:49:13.733408+0000","last_became_peered":"2023-03-06T13:49:13.733408+0000","last_unstale":"2023-03-06T13:49:14.854621+0000","last_undegraded":"2023-03-06T13:49:14.854621+0000","last_fullsized":"2023-03-06T13:49:14.854621+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T20:23:18.245157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:14.854581+0000","last_change":"2023-03-06T13:49:13.726066+0000","last_active":"2023-03-06T13:49:14.854581+0000","last_peered":"2023-03-06T13:49:14.854581+0000","last_clean":"2023-03-06T13:49:14.854581+0000","last_became_active":"2023-03-06T13:49:13.725767+0000","last_became_peered":"2023-03-06T13:49:13.725767+0000","last_unstale":"2023-03-06T13:49:14.854581+0000","last_undegraded":"2023-03-06T13:49:14.854581+0000","last_fullsized":"2023-03-06T13:49:14.854581+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T16:21:45.003183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:14.858552+0000","last_change":"2023-03-06T13:49:13.721687+0000","last_active":"2023-03-06T13:49:14.858552+0000","last_peered":"2023-03-06T13:49:14.858552+0000","last_clean":"2023-03-06T13:49:14.858552+0000","last_became_active":"2023-03-06T13:49:13.721400+0000","last_became_peered":"2023-03-06T13:49:13.721400+0000","last_unstale":"2023-03-06T13:49:14.858552+0000","last_undegraded":"2023-03-06T13:49:14.858552+0000","last_fullsized":"2023-03-06T13:49:14.858552+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T15:06:01.435712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:14.851340+0000","last_change":"2023-03-06T13:49:13.733193+0000","last_active":"2023-03-06T13:49:14.851340+0000","last_peered":"2023-03-06T13:49:14.851340+0000","last_clean":"2023-03-06T13:49:14.851340+0000","last_became_active":"2023-03-06T13:49:13.732559+0000","last_became_peered":"2023-03-06T13:49:13.732559+0000","last_unstale":"2023-03-06T13:49:14.851340+0000","last_undegraded":"2023-03-06T13:49:14.851340+0000","last_fullsized":"2023-03-06T13:49:14.851340+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T15:06:01.435712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:14.858330+0000","last_change":"2023-03-06T13:49:13.730075+0000","last_active":"2023-03-06T13:49:14.858330+0000","last_peered":"2023-03-06T13:49:14.858330+0000","last_clean":"2023-03-06T13:49:14.858330+0000","last_became_active":"2023-03-06T13:49:13.729158+0000","last_became_peered":"2023-03-06T13:49:13.729158+0000","last_unstale":"2023-03-06T13:49:14.858330+0000","last_undegraded":"2023-03-06T13:49:14.858330+0000","last_fullsized":"2023-03-06T13:49:14.858330+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T19:41:30.016073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:14.852091+0000","last_change":"2023-03-06T13:49:13.731030+0000","last_active":"2023-03-06T13:49:14.852091+0000","last_peered":"2023-03-06T13:49:14.852091+0000","last_clean":"2023-03-06T13:49:14.852091+0000","last_became_active":"2023-03-06T13:49:13.730786+0000","last_became_peered":"2023-03-06T13:49:13.730786+0000","last_unstale":"2023-03-06T13:49:14.852091+0000","last_undegraded":"2023-03-06T13:49:14.852091+0000","last_fullsized":"2023-03-06T13:49:14.852091+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T16:42:39.878112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:14.858591+0000","last_change":"2023-03-06T13:49:13.728942+0000","last_active":"2023-03-06T13:49:14.858591+0000","last_peered":"2023-03-06T13:49:14.858591+0000","last_clean":"2023-03-06T13:49:14.858591+0000","last_became_active":"2023-03-06T13:49:13.727975+0000","last_became_peered":"2023-03-06T13:49:13.727975+0000","last_unstale":"2023-03-06T13:49:14.858591+0000","last_undegraded":"2023-03-06T13:49:14.858591+0000","last_fullsized":"2023-03-06T13:49:14.858591+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T22:37:42.599167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:14.854661+0000","last_change":"2023-03-06T13:49:13.721970+0000","last_active":"2023-03-06T13:49:14.854661+0000","last_peered":"2023-03-06T13:49:14.854661+0000","last_clean":"2023-03-06T13:49:14.854661+0000","last_became_active":"2023-03-06T13:49:13.721722+0000","last_became_peered":"2023-03-06T13:49:13.721722+0000","last_unstale":"2023-03-06T13:49:14.854661+0000","last_undegraded":"2023-03-06T13:49:14.854661+0000","last_fullsized":"2023-03-06T13:49:14.854661+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T19:53:35.686308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:14.858490+0000","last_change":"2023-03-06T13:49:13.732576+0000","last_active":"2023-03-06T13:49:14.858490+0000","last_peered":"2023-03-06T13:49:14.858490+0000","last_clean":"2023-03-06T13:49:14.858490+0000","last_became_active":"2023-03-06T13:49:13.732314+0000","last_became_peered":"2023-03-06T13:49:13.732314+0000","last_unstale":"2023-03-06T13:49:14.858490+0000","last_undegraded":"2023-03-06T13:49:14.858490+0000","last_fullsized":"2023-03-06T13:49:14.858490+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T20:18:58.498628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:14.851382+0000","last_change":"2023-03-06T13:49:13.734115+0000","last_active":"2023-03-06T13:49:14.851382+0000","last_peered":"2023-03-06T13:49:14.851382+0000","last_clean":"2023-03-06T13:49:14.851382+0000","last_became_active":"2023-03-06T13:49:13.733850+0000","last_became_peered":"2023-03-06T13:49:13.733850+0000","last_unstale":"2023-03-06T13:49:14.851382+0000","last_undegraded":"2023-03-06T13:49:14.851382+0000","last_fullsized":"2023-03-06T13:49:14.851382+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T16:46:29.744316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:14.851977+0000","last_change":"2023-03-06T13:49:13.724411+0000","last_active":"2023-03-06T13:49:14.851977+0000","last_peered":"2023-03-06T13:49:14.851977+0000","last_clean":"2023-03-06T13:49:14.851977+0000","last_became_active":"2023-03-06T13:49:13.724151+0000","last_became_peered":"2023-03-06T13:49:13.724151+0000","last_unstale":"2023-03-06T13:49:14.851977+0000","last_undegraded":"2023-03-06T13:49:14.851977+0000","last_fullsized":"2023-03-06T13:49:14.851977+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T19:41:30.016073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:14.852554+0000","last_change":"2023-03-06T13:49:13.727285+0000","last_active":"2023-03-06T13:49:14.852554+0000","last_peered":"2023-03-06T13:49:14.852554+0000","last_clean":"2023-03-06T13:49:14.852554+0000","last_became_active":"2023-03-06T13:49:13.724921+0000","last_became_peered":"2023-03-06T13:49:13.724921+0000","last_unstale":"2023-03-06T13:49:14.852554+0000","last_undegraded":"2023-03-06T13:49:14.852554+0000","last_fullsized":"2023-03-06T13:49:14.852554+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-08T00:56:55.731171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:14.851266+0000","last_change":"2023-03-06T13:49:13.732435+0000","last_active":"2023-03-06T13:49:14.851266+0000","last_peered":"2023-03-06T13:49:14.851266+0000","last_clean":"2023-03-06T13:49:14.851266+0000","last_became_active":"2023-03-06T13:49:13.732118+0000","last_became_peered":"2023-03-06T13:49:13.732118+0000","last_unstale":"2023-03-06T13:49:14.851266+0000","last_undegraded":"2023-03-06T13:49:14.851266+0000","last_fullsized":"2023-03-06T13:49:14.851266+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T22:37:42.599167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-06T13:49:14.714294+0000","last_change":"2023-03-06T13:49:13.722347+0000","last_active":"2023-03-06T13:49:14.714294+0000","last_peered":"2023-03-06T13:49:14.714294+0000","last_clean":"2023-03-06T13:49:14.714294+0000","last_became_active":"2023-03-06T13:49:13.722089+0000","last_became_peered":"2023-03-06T13:49:13.722089+0000","last_unstale":"2023-03-06T13:49:14.714294+0000","last_undegraded":"2023-03-06T13:49:14.714294+0000","last_fullsized":"2023-03-06T13:49:14.714294+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T18:20:43.874725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-06T13:49:14.714475+0000","last_change":"2023-03-06T13:49:13.721459+0000","last_active":"2023-03-06T13:49:14.714475+0000","last_peered":"2023-03-06T13:49:14.714475+0000","last_clean":"2023-03-06T13:49:14.714475+0000","last_became_active":"2023-03-06T13:49:13.721210+0000","last_became_peered":"2023-03-06T13:49:13.721210+0000","last_unstale":"2023-03-06T13:49:14.714475+0000","last_undegraded":"2023-03-06T13:49:14.714475+0000","last_fullsized":"2023-03-06T13:49:14.714475+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T21:46:16.457828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:14.858623+0000","last_change":"2023-03-06T13:49:13.729761+0000","last_active":"2023-03-06T13:49:14.858623+0000","last_peered":"2023-03-06T13:49:14.858623+0000","last_clean":"2023-03-06T13:49:14.858623+0000","last_became_active":"2023-03-06T13:49:13.729301+0000","last_became_peered":"2023-03-06T13:49:13.729301+0000","last_unstale":"2023-03-06T13:49:14.858623+0000","last_undegraded":"2023-03-06T13:49:14.858623+0000","last_fullsized":"2023-03-06T13:49:14.858623+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T16:42:39.878112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"22'1","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:14.858418+0000","last_change":"2023-03-06T13:49:13.328562+0000","last_active":"2023-03-06T13:49:14.858418+0000","last_peered":"2023-03-06T13:49:14.858418+0000","last_clean":"2023-03-06T13:49:14.858418+0000","last_became_active":"2023-03-06T13:49:13.328314+0000","last_became_peered":"2023-03-06T13:49:13.328314+0000","last_unstale":"2023-03-06T13:49:14.858418+0000","last_undegraded":"2023-03-06T13:49:14.858418+0000","last_fullsized":"2023-03-06T13:49:14.858418+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_clean_scrub_stamp":"2023-03-06T13:49:12.303785+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-08T00:39:06.477914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:14.852610+0000","last_change":"2023-03-06T13:49:13.729956+0000","last_active":"2023-03-06T13:49:14.852610+0000","last_peered":"2023-03-06T13:49:14.852610+0000","last_clean":"2023-03-06T13:49:14.852610+0000","last_became_active":"2023-03-06T13:49:13.728115+0000","last_became_peered":"2023-03-06T13:49:13.728115+0000","last_unstale":"2023-03-06T13:49:14.852610+0000","last_undegraded":"2023-03-06T13:49:14.852610+0000","last_fullsized":"2023-03-06T13:49:14.852610+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T22:37:42.599167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-06T13:49:14.714081+0000","last_change":"2023-03-06T13:49:13.330148+0000","last_active":"2023-03-06T13:49:14.714081+0000","last_peered":"2023-03-06T13:49:14.714081+0000","last_clean":"2023-03-06T13:49:14.714081+0000","last_became_active":"2023-03-06T13:49:13.329874+0000","last_became_peered":"2023-03-06T13:49:13.329874+0000","last_unstale":"2023-03-06T13:49:14.714081+0000","last_undegraded":"2023-03-06T13:49:14.714081+0000","last_fullsized":"2023-03-06T13:49:14.714081+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_clean_scrub_stamp":"2023-03-06T13:49:12.303785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T14:43:51.863266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:14.852052+0000","last_change":"2023-03-06T13:49:13.726403+0000","last_active":"2023-03-06T13:49:14.852052+0000","last_peered":"2023-03-06T13:49:14.852052+0000","last_clean":"2023-03-06T13:49:14.852052+0000","last_became_active":"2023-03-06T13:49:13.726155+0000","last_became_peered":"2023-03-06T13:49:13.726155+0000","last_unstale":"2023-03-06T13:49:14.852052+0000","last_undegraded":"2023-03-06T13:49:14.852052+0000","last_fullsized":"2023-03-06T13:49:14.852052+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T18:43:12.631018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:14.852509+0000","last_change":"2023-03-06T13:49:13.333031+0000","last_active":"2023-03-06T13:49:14.852509+0000","last_peered":"2023-03-06T13:49:14.852509+0000","last_clean":"2023-03-06T13:49:14.852509+0000","last_became_active":"2023-03-06T13:49:13.332715+0000","last_became_peered":"2023-03-06T13:49:13.332715+0000","last_unstale":"2023-03-06T13:49:14.852509+0000","last_undegraded":"2023-03-06T13:49:14.852509+0000","last_fullsized":"2023-03-06T13:49:14.852509+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_clean_scrub_stamp":"2023-03-06T13:49:12.303785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T20:52:58.439733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-06T13:49:14.716097+0000","last_change":"2023-03-06T13:49:13.729931+0000","last_active":"2023-03-06T13:49:14.716097+0000","last_peered":"2023-03-06T13:49:14.716097+0000","last_clean":"2023-03-06T13:49:14.716097+0000","last_became_active":"2023-03-06T13:49:13.729657+0000","last_became_peered":"2023-03-06T13:49:13.729657+0000","last_unstale":"2023-03-06T13:49:14.716097+0000","last_undegraded":"2023-03-06T13:49:14.716097+0000","last_fullsized":"2023-03-06T13:49:14.716097+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T23:59:53.012700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:14.852101+0000","last_change":"2023-03-06T13:49:13.335979+0000","last_active":"2023-03-06T13:49:14.852101+0000","last_peered":"2023-03-06T13:49:14.852101+0000","last_clean":"2023-03-06T13:49:14.852101+0000","last_became_active":"2023-03-06T13:49:13.335701+0000","last_became_peered":"2023-03-06T13:49:13.335701+0000","last_unstale":"2023-03-06T13:49:14.852101+0000","last_undegraded":"2023-03-06T13:49:14.852101+0000","last_fullsized":"2023-03-06T13:49:14.852101+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_clean_scrub_stamp":"2023-03-06T13:49:12.303785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T19:17:35.350354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:14.852498+0000","last_change":"2023-03-06T13:49:13.721193+0000","last_active":"2023-03-06T13:49:14.852498+0000","last_peered":"2023-03-06T13:49:14.852498+0000","last_clean":"2023-03-06T13:49:14.852498+0000","last_became_active":"2023-03-06T13:49:13.720968+0000","last_became_peered":"2023-03-06T13:49:13.720968+0000","last_unstale":"2023-03-06T13:49:14.852498+0000","last_undegraded":"2023-03-06T13:49:14.852498+0000","last_fullsized":"2023-03-06T13:49:14.852498+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T16:42:39.878112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:14.858703+0000","last_change":"2023-03-06T13:49:13.336210+0000","last_active":"2023-03-06T13:49:14.858703+0000","last_peered":"2023-03-06T13:49:14.858703+0000","last_clean":"2023-03-06T13:49:14.858703+0000","last_became_active":"2023-03-06T13:49:13.335895+0000","last_became_peered":"2023-03-06T13:49:13.335895+0000","last_unstale":"2023-03-06T13:49:14.858703+0000","last_undegraded":"2023-03-06T13:49:14.858703+0000","last_fullsized":"2023-03-06T13:49:14.858703+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_clean_scrub_stamp":"2023-03-06T13:49:12.303785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T19:53:34.681954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:14.852539+0000","last_change":"2023-03-06T13:49:13.727461+0000","last_active":"2023-03-06T13:49:14.852539+0000","last_peered":"2023-03-06T13:49:14.852539+0000","last_clean":"2023-03-06T13:49:14.852539+0000","last_became_active":"2023-03-06T13:49:13.726691+0000","last_became_peered":"2023-03-06T13:49:13.726691+0000","last_unstale":"2023-03-06T13:49:14.852539+0000","last_undegraded":"2023-03-06T13:49:14.852539+0000","last_fullsized":"2023-03-06T13:49:14.852539+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-08T01:30:43.884806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"22'3","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:14.851418+0000","last_change":"2023-03-06T13:49:13.337258+0000","last_active":"2023-03-06T13:49:14.851418+0000","last_peered":"2023-03-06T13:49:14.851418+0000","last_clean":"2023-03-06T13:49:14.851418+0000","last_became_active":"2023-03-06T13:49:13.336956+0000","last_became_peered":"2023-03-06T13:49:13.336956+0000","last_unstale":"2023-03-06T13:49:14.851418+0000","last_undegraded":"2023-03-06T13:49:14.851418+0000","last_fullsized":"2023-03-06T13:49:14.851418+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_clean_scrub_stamp":"2023-03-06T13:49:12.303785+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T20:23:17.240803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-06T13:49:14.714418+0000","last_change":"2023-03-06T13:49:13.720024+0000","last_active":"2023-03-06T13:49:14.714418+0000","last_peered":"2023-03-06T13:49:14.714418+0000","last_clean":"2023-03-06T13:49:14.714418+0000","last_became_active":"2023-03-06T13:49:13.719745+0000","last_became_peered":"2023-03-06T13:49:13.719745+0000","last_unstale":"2023-03-06T13:49:14.714418+0000","last_undegraded":"2023-03-06T13:49:14.714418+0000","last_fullsized":"2023-03-06T13:49:14.714418+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T20:22:12.811857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"22'6","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:14.858510+0000","last_change":"2023-03-06T13:49:13.332863+0000","last_active":"2023-03-06T13:49:14.858510+0000","last_peered":"2023-03-06T13:49:14.858510+0000","last_clean":"2023-03-06T13:49:14.858510+0000","last_became_active":"2023-03-06T13:49:13.332579+0000","last_became_peered":"2023-03-06T13:49:13.332579+0000","last_unstale":"2023-03-06T13:49:14.858510+0000","last_undegraded":"2023-03-06T13:49:14.858510+0000","last_fullsized":"2023-03-06T13:49:14.858510+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_clean_scrub_stamp":"2023-03-06T13:49:12.303785+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T18:49:50.763848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1548,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:14.858468+0000","last_change":"2023-03-06T13:49:13.728503+0000","last_active":"2023-03-06T13:49:14.858468+0000","last_peered":"2023-03-06T13:49:14.858468+0000","last_clean":"2023-03-06T13:49:14.858468+0000","last_became_active":"2023-03-06T13:49:13.727740+0000","last_became_peered":"2023-03-06T13:49:13.727740+0000","last_unstale":"2023-03-06T13:49:14.858468+0000","last_undegraded":"2023-03-06T13:49:14.858468+0000","last_fullsized":"2023-03-06T13:49:14.858468+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-08T00:56:55.731171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.13","version":"22'2","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:14.851360+0000","last_change":"2023-03-06T13:49:13.336773+0000","last_active":"2023-03-06T13:49:14.851360+0000","last_peered":"2023-03-06T13:49:14.851360+0000","last_clean":"2023-03-06T13:49:14.851360+0000","last_became_active":"2023-03-06T13:49:13.336321+0000","last_became_peered":"2023-03-06T13:49:13.336321+0000","last_unstale":"2023-03-06T13:49:14.851360+0000","last_undegraded":"2023-03-06T13:49:14.851360+0000","last_fullsized":"2023-03-06T13:49:14.851360+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_clean_scrub_stamp":"2023-03-06T13:49:12.303785+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-08T01:45:44.452690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:14.852600+0000","last_change":"2023-03-06T13:49:13.725662+0000","last_active":"2023-03-06T13:49:14.852600+0000","last_peered":"2023-03-06T13:49:14.852600+0000","last_clean":"2023-03-06T13:49:14.852600+0000","last_became_active":"2023-03-06T13:49:13.725029+0000","last_became_peered":"2023-03-06T13:49:13.725029+0000","last_unstale":"2023-03-06T13:49:14.852600+0000","last_undegraded":"2023-03-06T13:49:14.852600+0000","last_fullsized":"2023-03-06T13:49:14.852600+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T19:41:30.016073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:14.851967+0000","last_change":"2023-03-06T13:49:13.332902+0000","last_active":"2023-03-06T13:49:14.851967+0000","last_peered":"2023-03-06T13:49:14.851967+0000","last_clean":"2023-03-06T13:49:14.851967+0000","last_became_active":"2023-03-06T13:49:13.332641+0000","last_became_peered":"2023-03-06T13:49:13.332641+0000","last_unstale":"2023-03-06T13:49:14.851967+0000","last_undegraded":"2023-03-06T13:49:14.851967+0000","last_fullsized":"2023-03-06T13:49:14.851967+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_clean_scrub_stamp":"2023-03-06T13:49:12.303785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T19:26:48.272662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:14.858634+0000","last_change":"2023-03-06T13:49:13.729557+0000","last_active":"2023-03-06T13:49:14.858634+0000","last_peered":"2023-03-06T13:49:14.858634+0000","last_clean":"2023-03-06T13:49:14.858634+0000","last_became_active":"2023-03-06T13:49:13.728917+0000","last_became_peered":"2023-03-06T13:49:13.728917+0000","last_unstale":"2023-03-06T13:49:14.858634+0000","last_undegraded":"2023-03-06T13:49:14.858634+0000","last_fullsized":"2023-03-06T13:49:14.858634+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T18:43:12.631018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:14.851321+0000","last_change":"2023-03-06T13:49:13.337738+0000","last_active":"2023-03-06T13:49:14.851321+0000","last_peered":"2023-03-06T13:49:14.851321+0000","last_clean":"2023-03-06T13:49:14.851321+0000","last_became_active":"2023-03-06T13:49:13.337441+0000","last_became_peered":"2023-03-06T13:49:13.337441+0000","last_unstale":"2023-03-06T13:49:14.851321+0000","last_undegraded":"2023-03-06T13:49:14.851321+0000","last_fullsized":"2023-03-06T13:49:14.851321+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_clean_scrub_stamp":"2023-03-06T13:49:12.303785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T19:17:35.350354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:14.852033+0000","last_change":"2023-03-06T13:49:13.725893+0000","last_active":"2023-03-06T13:49:14.852033+0000","last_peered":"2023-03-06T13:49:14.852033+0000","last_clean":"2023-03-06T13:49:14.852033+0000","last_became_active":"2023-03-06T13:49:13.725632+0000","last_became_peered":"2023-03-06T13:49:13.725632+0000","last_unstale":"2023-03-06T13:49:14.852033+0000","last_undegraded":"2023-03-06T13:49:14.852033+0000","last_fullsized":"2023-03-06T13:49:14.852033+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-08T00:56:55.731171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"22'8","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-06T13:49:14.715336+0000","last_change":"2023-03-06T13:49:13.325572+0000","last_active":"2023-03-06T13:49:14.715336+0000","last_peered":"2023-03-06T13:49:14.715336+0000","last_clean":"2023-03-06T13:49:14.715336+0000","last_became_active":"2023-03-06T13:49:13.325252+0000","last_became_peered":"2023-03-06T13:49:13.325252+0000","last_unstale":"2023-03-06T13:49:14.715336+0000","last_undegraded":"2023-03-06T13:49:14.715336+0000","last_fullsized":"2023-03-06T13:49:14.715336+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_clean_scrub_stamp":"2023-03-06T13:49:12.303785+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T18:49:50.763848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:14.852649+0000","last_change":"2023-03-06T13:49:13.730932+0000","last_active":"2023-03-06T13:49:14.852649+0000","last_peered":"2023-03-06T13:49:14.852649+0000","last_clean":"2023-03-06T13:49:14.852649+0000","last_became_active":"2023-03-06T13:49:13.728504+0000","last_became_peered":"2023-03-06T13:49:13.728504+0000","last_unstale":"2023-03-06T13:49:14.852649+0000","last_undegraded":"2023-03-06T13:49:14.852649+0000","last_fullsized":"2023-03-06T13:49:14.852649+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T16:46:29.744316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"22'1","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:14.851500+0000","last_change":"2023-03-06T13:49:13.336765+0000","last_active":"2023-03-06T13:49:14.851500+0000","last_peered":"2023-03-06T13:49:14.851500+0000","last_clean":"2023-03-06T13:49:14.851500+0000","last_became_active":"2023-03-06T13:49:13.336364+0000","last_became_peered":"2023-03-06T13:49:13.336364+0000","last_unstale":"2023-03-06T13:49:14.851500+0000","last_undegraded":"2023-03-06T13:49:14.851500+0000","last_fullsized":"2023-03-06T13:49:14.851500+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_clean_scrub_stamp":"2023-03-06T13:49:12.303785+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T23:59:52.008346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:14.858534+0000","last_change":"2023-03-06T13:49:13.725154+0000","last_active":"2023-03-06T13:49:14.858534+0000","last_peered":"2023-03-06T13:49:14.858534+0000","last_clean":"2023-03-06T13:49:14.858534+0000","last_became_active":"2023-03-06T13:49:13.724853+0000","last_became_peered":"2023-03-06T13:49:13.724853+0000","last_unstale":"2023-03-06T13:49:14.858534+0000","last_undegraded":"2023-03-06T13:49:14.858534+0000","last_fullsized":"2023-03-06T13:49:14.858534+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T23:04:29.575987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"22'2","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:14.851477+0000","last_change":"2023-03-06T13:49:13.336914+0000","last_active":"2023-03-06T13:49:14.851477+0000","last_peered":"2023-03-06T13:49:14.851477+0000","last_clean":"2023-03-06T13:49:14.851477+0000","last_became_active":"2023-03-06T13:49:13.336552+0000","last_became_peered":"2023-03-06T13:49:13.336552+0000","last_unstale":"2023-03-06T13:49:14.851477+0000","last_undegraded":"2023-03-06T13:49:14.851477+0000","last_fullsized":"2023-03-06T13:49:14.851477+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_clean_scrub_stamp":"2023-03-06T13:49:12.303785+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T16:21:43.998829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:14.858346+0000","last_change":"2023-03-06T13:49:13.730794+0000","last_active":"2023-03-06T13:49:14.858346+0000","last_peered":"2023-03-06T13:49:14.858346+0000","last_clean":"2023-03-06T13:49:14.858346+0000","last_became_active":"2023-03-06T13:49:13.730504+0000","last_became_peered":"2023-03-06T13:49:13.730504+0000","last_unstale":"2023-03-06T13:49:14.858346+0000","last_undegraded":"2023-03-06T13:49:14.858346+0000","last_fullsized":"2023-03-06T13:49:14.858346+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T23:04:29.575987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"22'1","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:14.851452+0000","last_change":"2023-03-06T13:49:13.335019+0000","last_active":"2023-03-06T13:49:14.851452+0000","last_peered":"2023-03-06T13:49:14.851452+0000","last_clean":"2023-03-06T13:49:14.851452+0000","last_became_active":"2023-03-06T13:49:13.334748+0000","last_became_peered":"2023-03-06T13:49:13.334748+0000","last_unstale":"2023-03-06T13:49:14.851452+0000","last_undegraded":"2023-03-06T13:49:14.851452+0000","last_fullsized":"2023-03-06T13:49:14.851452+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_clean_scrub_stamp":"2023-03-06T13:49:12.303785+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T18:44:54.544875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-06T13:49:14.715551+0000","last_change":"2023-03-06T13:49:13.722448+0000","last_active":"2023-03-06T13:49:14.715551+0000","last_peered":"2023-03-06T13:49:14.715551+0000","last_clean":"2023-03-06T13:49:14.715551+0000","last_became_active":"2023-03-06T13:49:13.719433+0000","last_became_peered":"2023-03-06T13:49:13.719433+0000","last_unstale":"2023-03-06T13:49:14.715551+0000","last_undegraded":"2023-03-06T13:49:14.715551+0000","last_fullsized":"2023-03-06T13:49:14.715551+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T19:17:36.354708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:14.858597+0000","last_change":"2023-03-06T13:49:13.329213+0000","last_active":"2023-03-06T13:49:14.858597+0000","last_peered":"2023-03-06T13:49:14.858597+0000","last_clean":"2023-03-06T13:49:14.858597+0000","last_became_active":"2023-03-06T13:49:13.328881+0000","last_became_peered":"2023-03-06T13:49:13.328881+0000","last_unstale":"2023-03-06T13:49:14.858597+0000","last_undegraded":"2023-03-06T13:49:14.858597+0000","last_fullsized":"2023-03-06T13:49:14.858597+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_clean_scrub_stamp":"2023-03-06T13:49:12.303785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-08T01:45:44.452690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:14.852023+0000","last_change":"2023-03-06T13:49:13.722967+0000","last_active":"2023-03-06T13:49:14.852023+0000","last_peered":"2023-03-06T13:49:14.852023+0000","last_clean":"2023-03-06T13:49:14.852023+0000","last_became_active":"2023-03-06T13:49:13.722502+0000","last_became_peered":"2023-03-06T13:49:13.722502+0000","last_unstale":"2023-03-06T13:49:14.852023+0000","last_undegraded":"2023-03-06T13:49:14.852023+0000","last_fullsized":"2023-03-06T13:49:14.852023+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T16:46:29.744316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"22'2","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:14.852577+0000","last_change":"2023-03-06T13:49:13.334295+0000","last_active":"2023-03-06T13:49:14.852577+0000","last_peered":"2023-03-06T13:49:14.852577+0000","last_clean":"2023-03-06T13:49:14.852577+0000","last_became_active":"2023-03-06T13:49:13.334029+0000","last_became_peered":"2023-03-06T13:49:13.334029+0000","last_unstale":"2023-03-06T13:49:14.852577+0000","last_undegraded":"2023-03-06T13:49:14.852577+0000","last_fullsized":"2023-03-06T13:49:14.852577+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_clean_scrub_stamp":"2023-03-06T13:49:12.303785+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T17:43:02.141473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:14.858523+0000","last_change":"2023-03-06T13:49:13.735942+0000","last_active":"2023-03-06T13:49:14.858523+0000","last_peered":"2023-03-06T13:49:14.858523+0000","last_clean":"2023-03-06T13:49:14.858523+0000","last_became_active":"2023-03-06T13:49:13.735605+0000","last_became_peered":"2023-03-06T13:49:13.735605+0000","last_unstale":"2023-03-06T13:49:14.858523+0000","last_undegraded":"2023-03-06T13:49:14.858523+0000","last_fullsized":"2023-03-06T13:49:14.858523+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-08T01:35:08.480796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-06T13:49:14.715543+0000","last_change":"2023-03-06T13:49:13.334902+0000","last_active":"2023-03-06T13:49:14.715543+0000","last_peered":"2023-03-06T13:49:14.715543+0000","last_clean":"2023-03-06T13:49:14.715543+0000","last_became_active":"2023-03-06T13:49:13.334117+0000","last_became_peered":"2023-03-06T13:49:13.334117+0000","last_unstale":"2023-03-06T13:49:14.715543+0000","last_undegraded":"2023-03-06T13:49:14.715543+0000","last_fullsized":"2023-03-06T13:49:14.715543+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_clean_scrub_stamp":"2023-03-06T13:49:12.303785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T19:15:21.274175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:14.858564+0000","last_change":"2023-03-06T13:49:13.735438+0000","last_active":"2023-03-06T13:49:14.858564+0000","last_peered":"2023-03-06T13:49:14.858564+0000","last_clean":"2023-03-06T13:49:14.858564+0000","last_became_active":"2023-03-06T13:49:13.734124+0000","last_became_peered":"2023-03-06T13:49:13.734124+0000","last_unstale":"2023-03-06T13:49:14.858564+0000","last_undegraded":"2023-03-06T13:49:14.858564+0000","last_fullsized":"2023-03-06T13:49:14.858564+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T21:05:03.457340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:14.858367+0000","last_change":"2023-03-06T13:49:13.331505+0000","last_active":"2023-03-06T13:49:14.858367+0000","last_peered":"2023-03-06T13:49:14.858367+0000","last_clean":"2023-03-06T13:49:14.858367+0000","last_became_active":"2023-03-06T13:49:13.331213+0000","last_became_peered":"2023-03-06T13:49:13.331213+0000","last_unstale":"2023-03-06T13:49:14.858367+0000","last_undegraded":"2023-03-06T13:49:14.858367+0000","last_fullsized":"2023-03-06T13:49:14.858367+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_clean_scrub_stamp":"2023-03-06T13:49:12.303785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T14:43:51.863266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:14.858577+0000","last_change":"2023-03-06T13:49:13.731378+0000","last_active":"2023-03-06T13:49:14.858577+0000","last_peered":"2023-03-06T13:49:14.858577+0000","last_clean":"2023-03-06T13:49:14.858577+0000","last_became_active":"2023-03-06T13:49:13.729527+0000","last_became_peered":"2023-03-06T13:49:13.729527+0000","last_unstale":"2023-03-06T13:49:14.858577+0000","last_undegraded":"2023-03-06T13:49:14.858577+0000","last_fullsized":"2023-03-06T13:49:14.858577+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T17:11:13.619652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:14.852486+0000","last_change":"2023-03-06T13:49:13.333554+0000","last_active":"2023-03-06T13:49:14.852486+0000","last_peered":"2023-03-06T13:49:14.852486+0000","last_clean":"2023-03-06T13:49:14.852486+0000","last_became_active":"2023-03-06T13:49:13.333290+0000","last_became_peered":"2023-03-06T13:49:13.333290+0000","last_unstale":"2023-03-06T13:49:14.852486+0000","last_undegraded":"2023-03-06T13:49:14.852486+0000","last_fullsized":"2023-03-06T13:49:14.852486+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_clean_scrub_stamp":"2023-03-06T13:49:12.303785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T19:53:34.681954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-06T13:49:14.714385+0000","last_change":"2023-03-06T13:49:13.727168+0000","last_active":"2023-03-06T13:49:14.714385+0000","last_peered":"2023-03-06T13:49:14.714385+0000","last_clean":"2023-03-06T13:49:14.714385+0000","last_became_active":"2023-03-06T13:49:13.726711+0000","last_became_peered":"2023-03-06T13:49:13.726711+0000","last_unstale":"2023-03-06T13:49:14.714385+0000","last_undegraded":"2023-03-06T13:49:14.714385+0000","last_fullsized":"2023-03-06T13:49:14.714385+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T19:41:30.016073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:13.714161+0000","last_change":"2023-03-06T13:49:08.699699+0000","last_active":"2023-03-06T13:49:13.714161+0000","last_peered":"2023-03-06T13:49:13.714161+0000","last_clean":"2023-03-06T13:49:13.714161+0000","last_became_active":"2023-03-06T13:49:08.699396+0000","last_became_peered":"2023-03-06T13:49:08.699396+0000","last_unstale":"2023-03-06T13:49:13.714161+0000","last_undegraded":"2023-03-06T13:49:13.714161+0000","last_fullsized":"2023-03-06T13:49:13.714161+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:07.278421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:07.278421+0000","last_clean_scrub_stamp":"2023-03-06T13:49:07.278421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-08T01:22:20.301600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:14.858647+0000","last_change":"2023-03-06T13:49:13.336126+0000","last_active":"2023-03-06T13:49:14.858647+0000","last_peered":"2023-03-06T13:49:14.858647+0000","last_clean":"2023-03-06T13:49:14.858647+0000","last_became_active":"2023-03-06T13:49:13.335530+0000","last_became_peered":"2023-03-06T13:49:13.335530+0000","last_unstale":"2023-03-06T13:49:14.858647+0000","last_undegraded":"2023-03-06T13:49:14.858647+0000","last_fullsized":"2023-03-06T13:49:14.858647+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_clean_scrub_stamp":"2023-03-06T13:49:12.303785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T16:21:43.998829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-06T13:49:14.714365+0000","last_change":"2023-03-06T13:49:13.727824+0000","last_active":"2023-03-06T13:49:14.714365+0000","last_peered":"2023-03-06T13:49:14.714365+0000","last_clean":"2023-03-06T13:49:14.714365+0000","last_became_active":"2023-03-06T13:49:13.727472+0000","last_became_peered":"2023-03-06T13:49:13.727472+0000","last_unstale":"2023-03-06T13:49:14.714365+0000","last_undegraded":"2023-03-06T13:49:14.714365+0000","last_fullsized":"2023-03-06T13:49:14.714365+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T22:37:42.599167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:13.713932+0000","last_change":"2023-03-06T13:49:08.306975+0000","last_active":"2023-03-06T13:49:13.713932+0000","last_peered":"2023-03-06T13:49:13.713932+0000","last_clean":"2023-03-06T13:49:13.713932+0000","last_became_active":"2023-03-06T13:49:08.306669+0000","last_became_peered":"2023-03-06T13:49:08.306669+0000","last_unstale":"2023-03-06T13:49:13.713932+0000","last_undegraded":"2023-03-06T13:49:13.713932+0000","last_fullsized":"2023-03-06T13:49:13.713932+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:07.278421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:07.278421+0000","last_clean_scrub_stamp":"2023-03-06T13:49:07.278421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T19:54:04.557386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:14.858479+0000","last_change":"2023-03-06T13:49:13.327601+0000","last_active":"2023-03-06T13:49:14.858479+0000","last_peered":"2023-03-06T13:49:14.858479+0000","last_clean":"2023-03-06T13:49:14.858479+0000","last_became_active":"2023-03-06T13:49:13.327317+0000","last_became_peered":"2023-03-06T13:49:13.327317+0000","last_unstale":"2023-03-06T13:49:14.858479+0000","last_undegraded":"2023-03-06T13:49:14.858479+0000","last_fullsized":"2023-03-06T13:49:14.858479+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_clean_scrub_stamp":"2023-03-06T13:49:12.303785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T19:15:21.274175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-06T13:49:14.714429+0000","last_change":"2023-03-06T13:49:13.728830+0000","last_active":"2023-03-06T13:49:14.714429+0000","last_peered":"2023-03-06T13:49:14.714429+0000","last_clean":"2023-03-06T13:49:14.714429+0000","last_became_active":"2023-03-06T13:49:13.726036+0000","last_became_peered":"2023-03-06T13:49:13.726036+0000","last_unstale":"2023-03-06T13:49:14.714429+0000","last_undegraded":"2023-03-06T13:49:14.714429+0000","last_fullsized":"2023-03-06T13:49:14.714429+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T15:06:01.435712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:13.709976+0000","last_change":"2023-03-06T13:49:08.314061+0000","last_active":"2023-03-06T13:49:13.709976+0000","last_peered":"2023-03-06T13:49:13.709976+0000","last_clean":"2023-03-06T13:49:13.709976+0000","last_became_active":"2023-03-06T13:49:08.313713+0000","last_became_peered":"2023-03-06T13:49:08.313713+0000","last_unstale":"2023-03-06T13:49:13.709976+0000","last_undegraded":"2023-03-06T13:49:13.709976+0000","last_fullsized":"2023-03-06T13:49:13.709976+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:07.278421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:07.278421+0000","last_clean_scrub_stamp":"2023-03-06T13:49:07.278421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T15:29:35.587025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-06T13:49:14.713974+0000","last_change":"2023-03-06T13:49:13.331494+0000","last_active":"2023-03-06T13:49:14.713974+0000","last_peered":"2023-03-06T13:49:14.713974+0000","last_clean":"2023-03-06T13:49:14.713974+0000","last_became_active":"2023-03-06T13:49:13.331229+0000","last_became_peered":"2023-03-06T13:49:13.331229+0000","last_unstale":"2023-03-06T13:49:14.713974+0000","last_undegraded":"2023-03-06T13:49:14.713974+0000","last_fullsized":"2023-03-06T13:49:14.713974+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_clean_scrub_stamp":"2023-03-06T13:49:12.303785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T19:53:34.681954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-06T13:49:14.714342+0000","last_change":"2023-03-06T13:49:13.727756+0000","last_active":"2023-03-06T13:49:14.714342+0000","last_peered":"2023-03-06T13:49:14.714342+0000","last_clean":"2023-03-06T13:49:14.714342+0000","last_became_active":"2023-03-06T13:49:13.727509+0000","last_became_peered":"2023-03-06T13:49:13.727509+0000","last_unstale":"2023-03-06T13:49:14.714342+0000","last_undegraded":"2023-03-06T13:49:14.714342+0000","last_fullsized":"2023-03-06T13:49:14.714342+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T16:46:29.744316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:13.713270+0000","last_change":"2023-03-06T13:49:08.307053+0000","last_active":"2023-03-06T13:49:13.713270+0000","last_peered":"2023-03-06T13:49:13.713270+0000","last_clean":"2023-03-06T13:49:13.713270+0000","last_became_active":"2023-03-06T13:49:08.306737+0000","last_became_peered":"2023-03-06T13:49:08.306737+0000","last_unstale":"2023-03-06T13:49:13.713270+0000","last_undegraded":"2023-03-06T13:49:13.713270+0000","last_fullsized":"2023-03-06T13:49:13.713270+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:07.278421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:07.278421+0000","last_clean_scrub_stamp":"2023-03-06T13:49:07.278421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T21:59:33.265276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":167,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:13.723777+0000","last_change":"2023-03-06T13:49:01.912106+0000","last_active":"2023-03-06T13:49:13.723777+0000","last_peered":"2023-03-06T13:49:13.723777+0000","last_clean":"2023-03-06T13:49:13.723777+0000","last_became_active":"2023-03-06T13:49:01.911157+0000","last_became_peered":"2023-03-06T13:49:01.911157+0000","last_unstale":"2023-03-06T13:49:13.723777+0000","last_undegraded":"2023-03-06T13:49:13.723777+0000","last_fullsized":"2023-03-06T13:49:13.723777+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:00.859533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:00.859533+0000","last_clean_scrub_stamp":"2023-03-06T13:49:00.859533+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T21:39:16.753876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:14.852566+0000","last_change":"2023-03-06T13:49:13.335291+0000","last_active":"2023-03-06T13:49:14.852566+0000","last_peered":"2023-03-06T13:49:14.852566+0000","last_clean":"2023-03-06T13:49:14.852566+0000","last_became_active":"2023-03-06T13:49:13.334976+0000","last_became_peered":"2023-03-06T13:49:13.334976+0000","last_unstale":"2023-03-06T13:49:14.852566+0000","last_undegraded":"2023-03-06T13:49:14.852566+0000","last_fullsized":"2023-03-06T13:49:14.852566+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_clean_scrub_stamp":"2023-03-06T13:49:12.303785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-08T01:45:44.452690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-06T13:49:14.715835+0000","last_change":"2023-03-06T13:49:13.730668+0000","last_active":"2023-03-06T13:49:14.715835+0000","last_peered":"2023-03-06T13:49:14.715835+0000","last_clean":"2023-03-06T13:49:14.715835+0000","last_became_active":"2023-03-06T13:49:13.730191+0000","last_became_peered":"2023-03-06T13:49:13.730191+0000","last_unstale":"2023-03-06T13:49:14.715835+0000","last_undegraded":"2023-03-06T13:49:14.715835+0000","last_fullsized":"2023-03-06T13:49:14.715835+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T20:23:18.245157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:13.724229+0000","last_change":"2023-03-06T13:49:08.307071+0000","last_active":"2023-03-06T13:49:13.724229+0000","last_peered":"2023-03-06T13:49:13.724229+0000","last_clean":"2023-03-06T13:49:13.724229+0000","last_became_active":"2023-03-06T13:49:08.306682+0000","last_became_peered":"2023-03-06T13:49:08.306682+0000","last_unstale":"2023-03-06T13:49:13.724229+0000","last_undegraded":"2023-03-06T13:49:13.724229+0000","last_fullsized":"2023-03-06T13:49:13.724229+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:07.278421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:07.278421+0000","last_clean_scrub_stamp":"2023-03-06T13:49:07.278421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T19:54:04.557386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:14.851950+0000","last_change":"2023-03-06T13:49:13.331989+0000","last_active":"2023-03-06T13:49:14.851950+0000","last_peered":"2023-03-06T13:49:14.851950+0000","last_clean":"2023-03-06T13:49:14.851950+0000","last_became_active":"2023-03-06T13:49:13.331679+0000","last_became_peered":"2023-03-06T13:49:13.331679+0000","last_unstale":"2023-03-06T13:49:14.851950+0000","last_undegraded":"2023-03-06T13:49:14.851950+0000","last_fullsized":"2023-03-06T13:49:14.851950+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_clean_scrub_stamp":"2023-03-06T13:49:12.303785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T19:53:34.681954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:14.852073+0000","last_change":"2023-03-06T13:49:13.722056+0000","last_active":"2023-03-06T13:49:14.852073+0000","last_peered":"2023-03-06T13:49:14.852073+0000","last_clean":"2023-03-06T13:49:14.852073+0000","last_became_active":"2023-03-06T13:49:13.721792+0000","last_became_peered":"2023-03-06T13:49:13.721792+0000","last_unstale":"2023-03-06T13:49:14.852073+0000","last_undegraded":"2023-03-06T13:49:14.852073+0000","last_fullsized":"2023-03-06T13:49:14.852073+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T22:37:42.599167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:13.726401+0000","last_change":"2023-03-06T13:49:08.699801+0000","last_active":"2023-03-06T13:49:13.726401+0000","last_peered":"2023-03-06T13:49:13.726401+0000","last_clean":"2023-03-06T13:49:13.726401+0000","last_became_active":"2023-03-06T13:49:08.699514+0000","last_became_peered":"2023-03-06T13:49:08.699514+0000","last_unstale":"2023-03-06T13:49:13.726401+0000","last_undegraded":"2023-03-06T13:49:13.726401+0000","last_fullsized":"2023-03-06T13:49:13.726401+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:07.278421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:07.278421+0000","last_clean_scrub_stamp":"2023-03-06T13:49:07.278421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-08T00:50:49.893386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-06T13:49:14.714510+0000","last_change":"2023-03-06T13:49:13.332420+0000","last_active":"2023-03-06T13:49:14.714510+0000","last_peered":"2023-03-06T13:49:14.714510+0000","last_clean":"2023-03-06T13:49:14.714510+0000","last_became_active":"2023-03-06T13:49:13.332115+0000","last_became_peered":"2023-03-06T13:49:13.332115+0000","last_unstale":"2023-03-06T13:49:14.714510+0000","last_undegraded":"2023-03-06T13:49:14.714510+0000","last_fullsized":"2023-03-06T13:49:14.714510+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_clean_scrub_stamp":"2023-03-06T13:49:12.303785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T20:52:58.439733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:14.851999+0000","last_change":"2023-03-06T13:49:13.728080+0000","last_active":"2023-03-06T13:49:14.851999+0000","last_peered":"2023-03-06T13:49:14.851999+0000","last_clean":"2023-03-06T13:49:14.851999+0000","last_became_active":"2023-03-06T13:49:13.727805+0000","last_became_peered":"2023-03-06T13:49:13.727805+0000","last_unstale":"2023-03-06T13:49:14.851999+0000","last_undegraded":"2023-03-06T13:49:14.851999+0000","last_fullsized":"2023-03-06T13:49:14.851999+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-08T01:30:43.884806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"22'2","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:14.852634+0000","last_change":"2023-03-06T13:49:13.333399+0000","last_active":"2023-03-06T13:49:14.852634+0000","last_peered":"2023-03-06T13:49:14.852634+0000","last_clean":"2023-03-06T13:49:14.852634+0000","last_became_active":"2023-03-06T13:49:13.333083+0000","last_became_peered":"2023-03-06T13:49:13.333083+0000","last_unstale":"2023-03-06T13:49:14.852634+0000","last_undegraded":"2023-03-06T13:49:14.852634+0000","last_fullsized":"2023-03-06T13:49:14.852634+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_clean_scrub_stamp":"2023-03-06T13:49:12.303785+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T19:26:48.272662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:13.714043+0000","last_change":"2023-03-06T13:49:08.303113+0000","last_active":"2023-03-06T13:49:13.714043+0000","last_peered":"2023-03-06T13:49:13.714043+0000","last_clean":"2023-03-06T13:49:13.714043+0000","last_became_active":"2023-03-06T13:49:08.302803+0000","last_became_peered":"2023-03-06T13:49:08.302803+0000","last_unstale":"2023-03-06T13:49:13.714043+0000","last_undegraded":"2023-03-06T13:49:13.714043+0000","last_fullsized":"2023-03-06T13:49:13.714043+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:07.278421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:07.278421+0000","last_clean_scrub_stamp":"2023-03-06T13:49:07.278421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T15:29:35.587025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:14.852472+0000","last_change":"2023-03-06T13:49:13.726793+0000","last_active":"2023-03-06T13:49:14.852472+0000","last_peered":"2023-03-06T13:49:14.852472+0000","last_clean":"2023-03-06T13:49:14.852472+0000","last_became_active":"2023-03-06T13:49:13.726528+0000","last_became_peered":"2023-03-06T13:49:13.726528+0000","last_unstale":"2023-03-06T13:49:14.852472+0000","last_undegraded":"2023-03-06T13:49:14.852472+0000","last_fullsized":"2023-03-06T13:49:14.852472+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T17:11:13.619652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:13.714479+0000","last_change":"2023-03-06T13:49:08.302357+0000","last_active":"2023-03-06T13:49:13.714479+0000","last_peered":"2023-03-06T13:49:13.714479+0000","last_clean":"2023-03-06T13:49:13.714479+0000","last_became_active":"2023-03-06T13:49:08.302038+0000","last_became_peered":"2023-03-06T13:49:08.302038+0000","last_unstale":"2023-03-06T13:49:13.714479+0000","last_undegraded":"2023-03-06T13:49:13.714479+0000","last_fullsized":"2023-03-06T13:49:13.714479+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:07.278421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:07.278421+0000","last_clean_scrub_stamp":"2023-03-06T13:49:07.278421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-08T01:22:20.301600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"23'1","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-06T13:49:15.099591+0000","last_change":"2023-03-06T13:49:13.327179+0000","last_active":"2023-03-06T13:49:15.099591+0000","last_peered":"2023-03-06T13:49:15.099591+0000","last_clean":"2023-03-06T13:49:15.099591+0000","last_became_active":"2023-03-06T13:49:13.326813+0000","last_became_peered":"2023-03-06T13:49:13.326813+0000","last_unstale":"2023-03-06T13:49:15.099591+0000","last_undegraded":"2023-03-06T13:49:15.099591+0000","last_fullsized":"2023-03-06T13:49:15.099591+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_clean_scrub_stamp":"2023-03-06T13:49:12.303785+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-08T01:45:44.452690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:14.858356+0000","last_change":"2023-03-06T13:49:13.733789+0000","last_active":"2023-03-06T13:49:14.858356+0000","last_peered":"2023-03-06T13:49:14.858356+0000","last_clean":"2023-03-06T13:49:14.858356+0000","last_became_active":"2023-03-06T13:49:13.733499+0000","last_became_peered":"2023-03-06T13:49:13.733499+0000","last_unstale":"2023-03-06T13:49:14.858356+0000","last_undegraded":"2023-03-06T13:49:14.858356+0000","last_fullsized":"2023-03-06T13:49:14.858356+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-08T00:51:17.885729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"22'1","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:14.852011+0000","last_change":"2023-03-06T13:49:13.330776+0000","last_active":"2023-03-06T13:49:14.852011+0000","last_peered":"2023-03-06T13:49:14.852011+0000","last_clean":"2023-03-06T13:49:14.852011+0000","last_became_active":"2023-03-06T13:49:13.330380+0000","last_became_peered":"2023-03-06T13:49:13.330380+0000","last_unstale":"2023-03-06T13:49:14.852011+0000","last_undegraded":"2023-03-06T13:49:14.852011+0000","last_fullsized":"2023-03-06T13:49:14.852011+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_clean_scrub_stamp":"2023-03-06T13:49:12.303785+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T16:21:43.998829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:14.854643+0000","last_change":"2023-03-06T13:49:13.721742+0000","last_active":"2023-03-06T13:49:14.854643+0000","last_peered":"2023-03-06T13:49:14.854643+0000","last_clean":"2023-03-06T13:49:14.854643+0000","last_became_active":"2023-03-06T13:49:13.721486+0000","last_became_peered":"2023-03-06T13:49:13.721486+0000","last_unstale":"2023-03-06T13:49:14.854643+0000","last_undegraded":"2023-03-06T13:49:14.854643+0000","last_fullsized":"2023-03-06T13:49:14.854643+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T19:26:49.277016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"22'2","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:14.858581+0000","last_change":"2023-03-06T13:49:13.335557+0000","last_active":"2023-03-06T13:49:14.858581+0000","last_peered":"2023-03-06T13:49:14.858581+0000","last_clean":"2023-03-06T13:49:14.858581+0000","last_became_active":"2023-03-06T13:49:13.335187+0000","last_became_peered":"2023-03-06T13:49:13.335187+0000","last_unstale":"2023-03-06T13:49:14.858581+0000","last_undegraded":"2023-03-06T13:49:14.858581+0000","last_fullsized":"2023-03-06T13:49:14.858581+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_clean_scrub_stamp":"2023-03-06T13:49:12.303785+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T20:23:17.240803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:14.858456+0000","last_change":"2023-03-06T13:49:13.735885+0000","last_active":"2023-03-06T13:49:14.858456+0000","last_peered":"2023-03-06T13:49:14.858456+0000","last_clean":"2023-03-06T13:49:14.858456+0000","last_became_active":"2023-03-06T13:49:13.735406+0000","last_became_peered":"2023-03-06T13:49:13.735406+0000","last_unstale":"2023-03-06T13:49:14.858456+0000","last_undegraded":"2023-03-06T13:49:14.858456+0000","last_fullsized":"2023-03-06T13:49:14.858456+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T20:35:34.805878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"22'2","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:14.858660+0000","last_change":"2023-03-06T13:49:13.331444+0000","last_active":"2023-03-06T13:49:14.858660+0000","last_peered":"2023-03-06T13:49:14.858660+0000","last_clean":"2023-03-06T13:49:14.858660+0000","last_became_active":"2023-03-06T13:49:13.331144+0000","last_became_peered":"2023-03-06T13:49:13.331144+0000","last_unstale":"2023-03-06T13:49:14.858660+0000","last_undegraded":"2023-03-06T13:49:14.858660+0000","last_fullsized":"2023-03-06T13:49:14.858660+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_clean_scrub_stamp":"2023-03-06T13:49:12.303785+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T19:17:35.350354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:14.858442+0000","last_change":"2023-03-06T13:49:13.736068+0000","last_active":"2023-03-06T13:49:14.858442+0000","last_peered":"2023-03-06T13:49:14.858442+0000","last_clean":"2023-03-06T13:49:14.858442+0000","last_became_active":"2023-03-06T13:49:13.735570+0000","last_became_peered":"2023-03-06T13:49:13.735570+0000","last_unstale":"2023-03-06T13:49:14.858442+0000","last_undegraded":"2023-03-06T13:49:14.858442+0000","last_fullsized":"2023-03-06T13:49:14.858442+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T20:03:32.232238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"22'1","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:14.852622+0000","last_change":"2023-03-06T13:49:13.328915+0000","last_active":"2023-03-06T13:49:14.852622+0000","last_peered":"2023-03-06T13:49:14.852622+0000","last_clean":"2023-03-06T13:49:14.852622+0000","last_became_active":"2023-03-06T13:49:13.328550+0000","last_became_peered":"2023-03-06T13:49:13.328550+0000","last_unstale":"2023-03-06T13:49:14.852622+0000","last_undegraded":"2023-03-06T13:49:14.852622+0000","last_fullsized":"2023-03-06T13:49:14.852622+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_clean_scrub_stamp":"2023-03-06T13:49:12.303785+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T14:43:51.863266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:14.852529+0000","last_change":"2023-03-06T13:49:13.727624+0000","last_active":"2023-03-06T13:49:14.852529+0000","last_peered":"2023-03-06T13:49:14.852529+0000","last_clean":"2023-03-06T13:49:14.852529+0000","last_became_active":"2023-03-06T13:49:13.727000+0000","last_became_peered":"2023-03-06T13:49:13.727000+0000","last_unstale":"2023-03-06T13:49:14.852529+0000","last_undegraded":"2023-03-06T13:49:14.852529+0000","last_fullsized":"2023-03-06T13:49:14.852529+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T15:06:01.435712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"22'4","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:14.852112+0000","last_change":"2023-03-06T13:49:13.334970+0000","last_active":"2023-03-06T13:49:14.852112+0000","last_peered":"2023-03-06T13:49:14.852112+0000","last_clean":"2023-03-06T13:49:14.852112+0000","last_became_active":"2023-03-06T13:49:13.334697+0000","last_became_peered":"2023-03-06T13:49:13.334697+0000","last_unstale":"2023-03-06T13:49:14.852112+0000","last_undegraded":"2023-03-06T13:49:14.852112+0000","last_fullsized":"2023-03-06T13:49:14.852112+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:12.303785+0000","last_clean_scrub_stamp":"2023-03-06T13:49:12.303785+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T20:23:17.240803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":566,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:14.858313+0000","last_change":"2023-03-06T13:49:13.728290+0000","last_active":"2023-03-06T13:49:14.858313+0000","last_peered":"2023-03-06T13:49:14.858313+0000","last_clean":"2023-03-06T13:49:14.858313+0000","last_became_active":"2023-03-06T13:49:13.727708+0000","last_became_peered":"2023-03-06T13:49:13.727708+0000","last_unstale":"2023-03-06T13:49:14.858313+0000","last_undegraded":"2023-03-06T13:49:14.858313+0000","last_fullsized":"2023-03-06T13:49:14.858313+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T16:42:39.878112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-06T13:49:14.715385+0000","last_change":"2023-03-06T13:49:13.723965+0000","last_active":"2023-03-06T13:49:14.715385+0000","last_peered":"2023-03-06T13:49:14.715385+0000","last_clean":"2023-03-06T13:49:14.715385+0000","last_became_active":"2023-03-06T13:49:13.723661+0000","last_became_peered":"2023-03-06T13:49:13.723661+0000","last_unstale":"2023-03-06T13:49:14.715385+0000","last_undegraded":"2023-03-06T13:49:14.715385+0000","last_fullsized":"2023-03-06T13:49:14.715385+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T23:31:39.512892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:14.852519+0000","last_change":"2023-03-06T13:49:13.731877+0000","last_active":"2023-03-06T13:49:14.852519+0000","last_peered":"2023-03-06T13:49:14.852519+0000","last_clean":"2023-03-06T13:49:14.852519+0000","last_became_active":"2023-03-06T13:49:13.728168+0000","last_became_peered":"2023-03-06T13:49:13.728168+0000","last_unstale":"2023-03-06T13:49:14.852519+0000","last_undegraded":"2023-03-06T13:49:14.852519+0000","last_fullsized":"2023-03-06T13:49:14.852519+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T18:43:12.631018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:14.858405+0000","last_change":"2023-03-06T13:49:13.730062+0000","last_active":"2023-03-06T13:49:14.858405+0000","last_peered":"2023-03-06T13:49:14.858405+0000","last_clean":"2023-03-06T13:49:14.858405+0000","last_became_active":"2023-03-06T13:49:13.729782+0000","last_became_peered":"2023-03-06T13:49:13.729782+0000","last_unstale":"2023-03-06T13:49:14.858405+0000","last_undegraded":"2023-03-06T13:49:14.858405+0000","last_fullsized":"2023-03-06T13:49:14.858405+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-08T01:30:43.884806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-06T13:49:14.852589+0000","last_change":"2023-03-06T13:49:13.725113+0000","last_active":"2023-03-06T13:49:14.852589+0000","last_peered":"2023-03-06T13:49:14.852589+0000","last_clean":"2023-03-06T13:49:14.852589+0000","last_became_active":"2023-03-06T13:49:13.724824+0000","last_became_peered":"2023-03-06T13:49:13.724824+0000","last_unstale":"2023-03-06T13:49:14.852589+0000","last_undegraded":"2023-03-06T13:49:14.852589+0000","last_fullsized":"2023-03-06T13:49:14.852589+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T20:18:58.498628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-06T13:49:14.714309+0000","last_change":"2023-03-06T13:49:13.724393+0000","last_active":"2023-03-06T13:49:14.714309+0000","last_peered":"2023-03-06T13:49:14.714309+0000","last_clean":"2023-03-06T13:49:14.714309+0000","last_became_active":"2023-03-06T13:49:13.724134+0000","last_became_peered":"2023-03-06T13:49:13.724134+0000","last_unstale":"2023-03-06T13:49:14.714309+0000","last_undegraded":"2023-03-06T13:49:14.714309+0000","last_fullsized":"2023-03-06T13:49:14.714309+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-06T13:49:13.308139+0000","last_clean_scrub_stamp":"2023-03-06T13:49:13.308139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-07T23:04:29.575987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2330,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574856,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9108,"kb_used_data":844,"kb_used_omap":0,"kb_used_meta":8256,"kb_avail":94362732,"statfs":{"total":96636764160,"available":96627437568,"internally_reserved":0,"allocated":864256,"data_stored":681731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8454144},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57699999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.503}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.43099999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48599999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67900000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67000000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65200000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574856,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7988,"kb_used_data":236,"kb_used_omap":0,"kb_used_meta":7744,"kb_avail":94363852,"statfs":{"total":96636764160,"available":96628584448,"internally_reserved":0,"allocated":241664,"data_stored":89599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7929856},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39700000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47199999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.4740000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.577}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45800000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41799999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54700000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574856,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8052,"kb_used_data":236,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363788,"statfs":{"total":96636764160,"available":96628518912,"internally_reserved":0,"allocated":241664,"data_stored":89599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32200000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28299999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42999999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.496}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54000000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.439}]}]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9084,"kb_used_data":820,"kb_used_omap":0,"kb_used_meta":8256,"kb_avail":94362756,"statfs":{"total":96636764160,"available":96627462144,"internally_reserved":0,"allocated":839680,"data_stored":680533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8454144},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.376}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.314}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26000000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45200000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44600000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58499999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42099999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574856,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7924,"kb_used_data":236,"kb_used_omap":0,"kb_used_meta":7680,"kb_avail":94363916,"statfs":{"total":96636764160,"available":96628649984,"internally_reserved":0,"allocated":241664,"data_stored":89599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7864320},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.262}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64700000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3320000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76000000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72999999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":5.2000000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":5.2910000000000004}]}]},{"osd":3,"up_from":13,"seq":55834574856,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8056,"kb_used_data":240,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363784,"statfs":{"total":96636764160,"available":96628514816,"internally_reserved":0,"allocated":245760,"data_stored":89689,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.159}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80200000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":11.061999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.024}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":11.031000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0960000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8072,"kb_used_data":256,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363768,"statfs":{"total":96636764160,"available":96628498432,"internally_reserved":0,"allocated":262144,"data_stored":91203,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65800000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53000000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.432}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.503}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59099999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.62}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64700000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574856,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7996,"kb_used_data":244,"kb_used_omap":0,"kb_used_meta":7744,"kb_avail":94363844,"statfs":{"total":96636764160,"available":96628576256,"internally_reserved":0,"allocated":249856,"data_stored":90235,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7929856},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55100000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48399999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.436}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61699999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41799999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36299999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39800000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-03-06T13:49:22.738 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-03-06T13:49:22.739 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-03-06T13:49:22.739 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-03-06T13:49:22.739 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-03-06T13:49:22.891 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:22.889+0000 7f7977adb700 1 Processor -- start 2023-03-06T13:49:22.891 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:22.889+0000 7f7977adb700 1 -- start start 2023-03-06T13:49:22.892 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:22.890+0000 7f7977adb700 1 --2- >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f797006ea90 0x7f797014f0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:22.892 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:22.890+0000 7f7977adb700 1 --2- >> v2:172.21.15.202:3300/0 conn(0x7f797014f600 0x7f7970159a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:22.893 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:22.890+0000 7f7977adb700 1 -- --> v1:172.21.15.202:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7970153340 con 0x7f7970149420 2023-03-06T13:49:22.893 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:22.890+0000 7f7977adb700 1 -- --> v2:172.21.15.202:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79701497f0 con 0x7f797014f600 2023-03-06T13:49:22.893 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:22.890+0000 7f7977adb700 1 -- --> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7970152750 con 0x7f797006ea90 2023-03-06T13:49:22.893 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:22.890+0000 7f7975076700 1 --2- >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f797006ea90 0x7f797014f0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:22.893 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:22.890+0000 7f7976078700 1 --2- >> v2:172.21.15.202:3300/0 conn(0x7f797014f600 0x7f7970159a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:22.893 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:22.890+0000 7f7975076700 1 --2- >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f797006ea90 0x7f797014f0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.202:3301/0 says I am v2:172.21.15.86:50808/0 (socket says 172.21.15.86:50808) 2023-03-06T13:49:22.893 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:22.890+0000 7f7975076700 1 -- 172.21.15.86:0/4140997351 learned_addr learned my addr 172.21.15.86:0/4140997351 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-03-06T13:49:22.894 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:22.891+0000 7f7975076700 1 -- 172.21.15.86:0/4140997351 >> v2:172.21.15.202:3300/0 conn(0x7f797014f600 msgr2=0x7f7970159a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T13:49:22.894 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:22.891+0000 7f7975076700 1 --2- 172.21.15.86:0/4140997351 >> v2:172.21.15.202:3300/0 conn(0x7f797014f600 0x7f7970159a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:22.894 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:22.891+0000 7f7975076700 1 -- 172.21.15.86:0/4140997351 >> v1:172.21.15.202:6789/0 conn(0x7f7970149420 legacy=0x7f79700c2860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:22.894 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:22.891+0000 7f7975076700 1 -- 172.21.15.86:0/4140997351 --> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7970152a10 con 0x7f797006ea90 2023-03-06T13:49:22.894 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:22.891+0000 7f7976078700 1 --2- 172.21.15.86:0/4140997351 >> v2:172.21.15.202:3300/0 conn(0x7f797014f600 0x7f7970159a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-06T13:49:22.894 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:22.891+0000 7f7975076700 1 --2- 172.21.15.86:0/4140997351 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f797006ea90 0x7f797014f0c0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f796c0098f0 tx=0x7f796c009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c53fe35435cf0d19 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T13:49:22.896 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:22.891+0000 7f7974875700 1 -- 172.21.15.86:0/4140997351 <== mon.2 v2:172.21.15.202:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f796c011830 con 0x7f797006ea90 2023-03-06T13:49:22.897 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:22.891+0000 7f7974875700 1 -- 172.21.15.86:0/4140997351 <== mon.2 v2:172.21.15.202:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f796c011990 con 0x7f797006ea90 2023-03-06T13:49:22.897 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:22.891+0000 7f7974875700 1 -- 172.21.15.86:0/4140997351 <== mon.2 v2:172.21.15.202:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f796c011d20 con 0x7f797006ea90 2023-03-06T13:49:22.897 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:22.891+0000 7f7977adb700 1 -- 172.21.15.86:0/4140997351 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f797006ea90 msgr2=0x7f797014f0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:22.897 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:22.891+0000 7f7977adb700 1 --2- 172.21.15.86:0/4140997351 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f797006ea90 0x7f797014f0c0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f796c0098f0 tx=0x7f796c009c00 comp rx=0 tx=0).stop 2023-03-06T13:49:22.897 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:22.892+0000 7f7977adb700 1 -- 172.21.15.86:0/4140997351 shutdown_connections 2023-03-06T13:49:22.897 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:22.892+0000 7f7977adb700 1 --2- 172.21.15.86:0/4140997351 >> v2:172.21.15.202:3300/0 conn(0x7f797014f600 0x7f7970159a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:22.897 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:22.892+0000 7f7977adb700 1 --2- 172.21.15.86:0/4140997351 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f797006ea90 0x7f797014f0c0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:22.898 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:22.892+0000 7f7977adb700 1 -- 172.21.15.86:0/4140997351 >> 172.21.15.86:0/4140997351 conn(0x7f797006c0d0 msgr2=0x7f79700c2150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T13:49:22.898 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:22.892+0000 7f7977adb700 1 -- 172.21.15.86:0/4140997351 shutdown_connections 2023-03-06T13:49:22.898 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:22.892+0000 7f7977adb700 1 -- 172.21.15.86:0/4140997351 wait complete. 2023-03-06T13:49:22.898 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:22.893+0000 7f7977adb700 1 Processor -- start 2023-03-06T13:49:22.898 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:22.893+0000 7f7977adb700 1 -- start start 2023-03-06T13:49:22.898 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:22.893+0000 7f7977adb700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f797006ea90 0x7f79701e5c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:22.898 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:22.893+0000 7f7977adb700 1 --2- >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f7970149420 0x7f7970146980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:22.899 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:22.893+0000 7f7977adb700 1 --2- >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f797014f600 0x7f79701e8ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:22.899 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:22.893+0000 7f7977adb700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f797014aaa0 con 0x7f797006ea90 2023-03-06T13:49:22.899 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:22.893+0000 7f7977adb700 1 -- --> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79701e6180 con 0x7f797014f600 2023-03-06T13:49:22.899 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:22.893+0000 7f7977adb700 1 -- --> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79701e8730 con 0x7f7970149420 2023-03-06T13:49:22.899 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:22.893+0000 7f7975877700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f797006ea90 0x7f79701e5c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:22.899 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:22.893+0000 7f7975877700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f797006ea90 0x7f79701e5c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:39118/0 (socket says 172.21.15.86:39118) 2023-03-06T13:49:22.899 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:22.893+0000 7f7975877700 1 -- 172.21.15.86:0/739417569 learned_addr learned my addr 172.21.15.86:0/739417569 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-03-06T13:49:22.899 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:22.894+0000 7f7976078700 1 --2- 172.21.15.86:0/739417569 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f797014f600 0x7f79701e8ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:22.900 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:22.894+0000 7f7975076700 1 --2- 172.21.15.86:0/739417569 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f7970149420 0x7f7970146980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:22.900 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:22.894+0000 7f7975877700 1 -- 172.21.15.86:0/739417569 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f7970149420 msgr2=0x7f7970146980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:22.900 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:22.894+0000 7f7975877700 1 --2- 172.21.15.86:0/739417569 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f7970149420 0x7f7970146980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:22.900 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:22.894+0000 7f7975877700 1 -- 172.21.15.86:0/739417569 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f797014f600 msgr2=0x7f79701e8ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:22.900 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:22.894+0000 7f7975877700 1 --2- 172.21.15.86:0/739417569 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f797014f600 0x7f79701e8ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:22.900 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:22.894+0000 7f7975877700 1 -- 172.21.15.86:0/739417569 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7968009a70 con 0x7f797006ea90 2023-03-06T13:49:22.900 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:22.894+0000 7f7975877700 1 --2- 172.21.15.86:0/739417569 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f797006ea90 0x7f79701e5c40 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f796000c430 tx=0x7f796000c740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T13:49:22.901 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:22.894+0000 7f79667fc700 1 -- 172.21.15.86:0/739417569 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79600052d0 con 0x7f797006ea90 2023-03-06T13:49:22.901 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:22.894+0000 7f79667fc700 1 -- 172.21.15.86:0/739417569 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7960005450 con 0x7f797006ea90 2023-03-06T13:49:22.901 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:22.894+0000 7f7977adb700 1 -- 172.21.15.86:0/739417569 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f796c009550 con 0x7f797006ea90 2023-03-06T13:49:22.901 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:22.894+0000 7f79667fc700 1 -- 172.21.15.86:0/739417569 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7960006aa0 con 0x7f797006ea90 2023-03-06T13:49:22.901 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:22.894+0000 7f7977adb700 1 -- 172.21.15.86:0/739417569 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7970152fd0 con 0x7f797006ea90 2023-03-06T13:49:22.902 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:22.895+0000 7f7977adb700 1 -- 172.21.15.86:0/739417569 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7970152cf0 con 0x7f797006ea90 2023-03-06T13:49:22.902 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:22.896+0000 7f79667fc700 1 -- 172.21.15.86:0/739417569 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f7960010050 con 0x7f797006ea90 2023-03-06T13:49:22.902 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:22.896+0000 7f79667fc700 1 --2- 172.21.15.86:0/739417569 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7f79540682f0 0x7f795406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:22.902 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:22.896+0000 7f79667fc700 1 -- 172.21.15.86:0/739417569 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7960084bc0 con 0x7f797006ea90 2023-03-06T13:49:22.903 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:22.896+0000 7f7975076700 1 --2- 172.21.15.86:0/739417569 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7f79540682f0 0x7f795406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:22.903 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:22.896+0000 7f7975076700 1 --2- 172.21.15.86:0/739417569 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7f79540682f0 0x7f795406a7a0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f796c014040 tx=0x7f796c008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T13:49:22.903 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:22.900+0000 7f79667fc700 1 -- 172.21.15.86:0/739417569 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f796004a5e0 con 0x7f797006ea90 2023-03-06T13:49:23.127 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:23.124+0000 7f7977adb700 1 -- 172.21.15.86:0/739417569 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f797006e610 con 0x7f797006ea90 2023-03-06T13:49:23.127 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:23.125+0000 7f79667fc700 1 -- 172.21.15.86:0/739417569 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f7960051420 con 0x7f797006ea90 2023-03-06T13:49:23.128 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-03-06T13:49:23.128 INFO:teuthology.orchestra.run.smithi086.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-03-06T13:49:23.129 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:23.127+0000 7f7977adb700 1 -- 172.21.15.86:0/739417569 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7f79540682f0 msgr2=0x7f795406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:23.130 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:23.127+0000 7f7977adb700 1 --2- 172.21.15.86:0/739417569 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7f79540682f0 0x7f795406a7a0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f796c014040 tx=0x7f796c008030 comp rx=0 tx=0).stop 2023-03-06T13:49:23.130 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:23.127+0000 7f7977adb700 1 -- 172.21.15.86:0/739417569 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f797006ea90 msgr2=0x7f79701e5c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:23.130 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:23.127+0000 7f7977adb700 1 --2- 172.21.15.86:0/739417569 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f797006ea90 0x7f79701e5c40 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f796000c430 tx=0x7f796000c740 comp rx=0 tx=0).stop 2023-03-06T13:49:23.130 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:23.127+0000 7f7977adb700 1 -- 172.21.15.86:0/739417569 shutdown_connections 2023-03-06T13:49:23.131 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:23.127+0000 7f7977adb700 1 --2- 172.21.15.86:0/739417569 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7f79540682f0 0x7f795406a7a0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:23.131 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:23.127+0000 7f7977adb700 1 --2- 172.21.15.86:0/739417569 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f797006ea90 0x7f79701e5c40 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:23.131 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:23.127+0000 7f7977adb700 1 --2- 172.21.15.86:0/739417569 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f797014f600 0x7f79701e8ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:23.131 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:23.127+0000 7f7977adb700 1 --2- 172.21.15.86:0/739417569 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f7970149420 0x7f7970146980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:23.131 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:23.127+0000 7f7977adb700 1 -- 172.21.15.86:0/739417569 >> 172.21.15.86:0/739417569 conn(0x7f797006c0d0 msgr2=0x7f79701476b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T13:49:23.131 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:23.127+0000 7f7977adb700 1 -- 172.21.15.86:0/739417569 shutdown_connections 2023-03-06T13:49:23.131 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:23.127+0000 7f7977adb700 1 -- 172.21.15.86:0/739417569 wait complete. 2023-03-06T13:49:23.140 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-03-06T13:49:23.141 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-03-06T13:49:23.260 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:23.258+0000 7fdb83397700 1 Processor -- start 2023-03-06T13:49:23.261 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:23.259+0000 7fdb83397700 1 -- start start 2023-03-06T13:49:23.264 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:23.259+0000 7fdb83397700 1 --2- >> v2:172.21.15.202:3300/0 conn(0x7fdb7c14f7d0 0x7fdb7c15aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:23.264 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:23.259+0000 7fdb83397700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb7c153340 con 0x7fdb7c149420 2023-03-06T13:49:23.264 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:23.259+0000 7fdb83397700 1 -- --> v1:172.21.15.202:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb7c1497f0 con 0x7fdb7c06ea90 2023-03-06T13:49:23.265 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:23.259+0000 7fdb83397700 1 -- --> v2:172.21.15.202:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb7c152750 con 0x7fdb7c14f7d0 2023-03-06T13:49:23.265 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:23.259+0000 7fdb81133700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7fdb7c149420 0x7fdb7c0c2860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:49274/0 (socket says 172.21.15.86:49274) 2023-03-06T13:49:23.265 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:23.260+0000 7fdb81133700 1 -- 172.21.15.86:0/2384182276 learned_addr learned my addr 172.21.15.86:0/2384182276 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-03-06T13:49:23.265 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:23.260+0000 7fdb81934700 1 --2- 172.21.15.86:0/2384182276 >> v2:172.21.15.202:3300/0 conn(0x7fdb7c14f7d0 0x7fdb7c15aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:23.265 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:23.260+0000 7fdb73fff700 1 -- 172.21.15.86:0/2384182276 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1174793681 0 0) 0x7fdb7c153340 con 0x7fdb7c149420 2023-03-06T13:49:23.265 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:23.260+0000 7fdb73fff700 1 -- 172.21.15.86:0/2384182276 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdb680035b0 con 0x7fdb7c149420 2023-03-06T13:49:23.265 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:23.260+0000 7fdb73fff700 1 -- 172.21.15.86:0/2384182276 <== mon.0 v1:172.21.15.86:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 282627891 0 0) 0x7fdb680035b0 con 0x7fdb7c149420 2023-03-06T13:49:23.266 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:23.260+0000 7fdb73fff700 1 -- 172.21.15.86:0/2384182276 >> v2:172.21.15.202:3300/0 conn(0x7fdb7c14f7d0 msgr2=0x7fdb7c15aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T13:49:23.266 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:23.260+0000 7fdb73fff700 1 --2- 172.21.15.86:0/2384182276 >> v2:172.21.15.202:3300/0 conn(0x7fdb7c14f7d0 0x7fdb7c15aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:23.266 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:23.260+0000 7fdb73fff700 1 -- 172.21.15.86:0/2384182276 >> v1:172.21.15.202:6789/0 conn(0x7fdb7c06ea90 legacy=0x7fdb7c14f0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:23.266 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:23.260+0000 7fdb73fff700 1 -- 172.21.15.86:0/2384182276 --> v1:172.21.15.86:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb7c152a10 con 0x7fdb7c149420 2023-03-06T13:49:23.266 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:23.260+0000 7fdb73fff700 1 -- 172.21.15.86:0/2384182276 <== mon.0 v1:172.21.15.86:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2191261126 0 0) 0x7fdb6c001670 con 0x7fdb7c149420 2023-03-06T13:49:23.266 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:23.260+0000 7fdb73fff700 1 -- 172.21.15.86:0/2384182276 >> v1:172.21.15.86:6789/0 conn(0x7fdb7c149420 legacy=0x7fdb7c0c2860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:23.266 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:23.260+0000 7fdb73fff700 1 --2- 172.21.15.86:0/2384182276 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fdb68003a70 0x7fdb68003e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:23.267 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:23.260+0000 7fdb73fff700 1 --2- 172.21.15.86:0/2384182276 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7fdb68004850 0x7fdb68004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:23.267 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:23.260+0000 7fdb73fff700 1 --2- 172.21.15.86:0/2384182276 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdb68005320 0x7fdb6800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:23.267 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:23.260+0000 7fdb73fff700 1 -- 172.21.15.86:0/2384182276 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb7c152750 con 0x7fdb68005320 2023-03-06T13:49:23.267 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:23.260+0000 7fdb73fff700 1 -- 172.21.15.86:0/2384182276 --> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb6800c230 con 0x7fdb68004850 2023-03-06T13:49:23.267 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:23.260+0000 7fdb73fff700 1 -- 172.21.15.86:0/2384182276 --> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb6800c3f0 con 0x7fdb68003a70 2023-03-06T13:49:23.267 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:23.260+0000 7fdb81934700 1 --2- 172.21.15.86:0/2384182276 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdb68005320 0x7fdb6800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:23.267 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:23.260+0000 7fdb80932700 1 --2- 172.21.15.86:0/2384182276 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7fdb68004850 0x7fdb68004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:23.267 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:23.260+0000 7fdb81133700 1 --2- 172.21.15.86:0/2384182276 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fdb68003a70 0x7fdb68003e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:23.268 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:23.260+0000 7fdb81934700 1 -- 172.21.15.86:0/2384182276 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fdb68003a70 msgr2=0x7fdb68003e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T13:49:23.268 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:23.260+0000 7fdb81934700 1 --2- 172.21.15.86:0/2384182276 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fdb68003a70 0x7fdb68003e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:23.268 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:23.260+0000 7fdb81934700 1 -- 172.21.15.86:0/2384182276 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7fdb68004850 msgr2=0x7fdb68004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T13:49:23.268 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:23.260+0000 7fdb81934700 1 --2- 172.21.15.86:0/2384182276 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7fdb68004850 0x7fdb68004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:23.268 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:23.260+0000 7fdb81934700 1 -- 172.21.15.86:0/2384182276 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb680035b0 con 0x7fdb68005320 2023-03-06T13:49:23.268 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:23.261+0000 7fdb81934700 1 -- 172.21.15.86:0/2384182276 reap_dead start 2023-03-06T13:49:23.268 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:23.261+0000 7fdb81934700 1 --2- 172.21.15.86:0/2384182276 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdb68005320 0x7fdb6800ba10 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fdb74009fc0 tx=0x7fdb68005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=319700021aa7bcbe server_cookie=0 in_seq=0 out_seq=0 2023-03-06T13:49:23.268 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:23.261+0000 7fdb73fff700 1 -- 172.21.15.86:0/2384182276 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb74003a20 con 0x7fdb68005320 2023-03-06T13:49:23.269 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:23.261+0000 7fdb73fff700 1 -- 172.21.15.86:0/2384182276 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb7400f040 con 0x7fdb68005320 2023-03-06T13:49:23.269 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:23.261+0000 7fdb73fff700 1 -- 172.21.15.86:0/2384182276 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb74003da0 con 0x7fdb68005320 2023-03-06T13:49:23.269 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:23.261+0000 7fdb83397700 1 -- 172.21.15.86:0/2384182276 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdb68005320 msgr2=0x7fdb6800ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:23.269 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:23.261+0000 7fdb83397700 1 --2- 172.21.15.86:0/2384182276 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdb68005320 0x7fdb6800ba10 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fdb74009fc0 tx=0x7fdb68005880 comp rx=0 tx=0).stop 2023-03-06T13:49:23.269 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:23.261+0000 7fdb83397700 1 -- 172.21.15.86:0/2384182276 shutdown_connections 2023-03-06T13:49:23.269 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:23.261+0000 7fdb83397700 1 --2- 172.21.15.86:0/2384182276 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdb68005320 0x7fdb6800ba10 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:23.269 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:23.261+0000 7fdb83397700 1 -- 172.21.15.86:0/2384182276 >> 172.21.15.86:0/2384182276 conn(0x7fdb7c06c0d0 msgr2=0x7fdb7c0c2150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T13:49:23.270 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:23.261+0000 7fdb83397700 1 -- 172.21.15.86:0/2384182276 shutdown_connections 2023-03-06T13:49:23.270 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:23.261+0000 7fdb83397700 1 -- 172.21.15.86:0/2384182276 wait complete. 2023-03-06T13:49:23.270 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:23.262+0000 7fdb83397700 1 Processor -- start 2023-03-06T13:49:23.270 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:23.262+0000 7fdb83397700 1 -- start start 2023-03-06T13:49:23.272 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:23.263+0000 7fdb83397700 1 --2- >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7fdb68005320 0x7fdb7c14b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:23.272 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:23.263+0000 7fdb83397700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdb7c1499b0 0x7fdb7c14a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:23.272 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:23.263+0000 7fdb83397700 1 --2- >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fdb7c145dc0 0x7fdb7c06a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:23.272 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:23.263+0000 7fdb83397700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb7c14ee00 con 0x7fdb7c1499b0 2023-03-06T13:49:23.273 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:23.263+0000 7fdb83397700 1 -- --> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb7c146260 con 0x7fdb68005320 2023-03-06T13:49:23.273 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:23.263+0000 7fdb83397700 1 -- --> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb7c06ad40 con 0x7fdb7c145dc0 2023-03-06T13:49:23.273 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:23.263+0000 7fdb80932700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdb7c1499b0 0x7fdb7c14a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:23.273 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:23.263+0000 7fdb80932700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdb7c1499b0 0x7fdb7c14a860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:39140/0 (socket says 172.21.15.86:39140) 2023-03-06T13:49:23.274 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:23.263+0000 7fdb80932700 1 -- 172.21.15.86:0/4031970006 learned_addr learned my addr 172.21.15.86:0/4031970006 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-03-06T13:49:23.274 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:23.263+0000 7fdb81934700 1 --2- 172.21.15.86:0/4031970006 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fdb7c145dc0 0x7fdb7c06a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:23.274 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:23.263+0000 7fdb81133700 1 --2- 172.21.15.86:0/4031970006 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7fdb68005320 0x7fdb7c14b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:23.274 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:23.263+0000 7fdb80932700 1 -- 172.21.15.86:0/4031970006 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fdb7c145dc0 msgr2=0x7fdb7c06a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:23.274 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:23.264+0000 7fdb80932700 1 --2- 172.21.15.86:0/4031970006 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fdb7c145dc0 0x7fdb7c06a5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:23.274 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:23.264+0000 7fdb80932700 1 -- 172.21.15.86:0/4031970006 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7fdb68005320 msgr2=0x7fdb7c14b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:23.274 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:23.264+0000 7fdb80932700 1 --2- 172.21.15.86:0/4031970006 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7fdb68005320 0x7fdb7c14b0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:23.275 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:23.264+0000 7fdb80932700 1 -- 172.21.15.86:0/4031970006 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb7c152fd0 con 0x7fdb7c1499b0 2023-03-06T13:49:23.275 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:23.264+0000 7fdb81133700 1 --2- 172.21.15.86:0/4031970006 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7fdb68005320 0x7fdb7c14b0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-06T13:49:23.275 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:23.264+0000 7fdb81934700 1 --2- 172.21.15.86:0/4031970006 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fdb7c145dc0 0x7fdb7c06a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-06T13:49:23.275 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:23.264+0000 7fdb80932700 1 --2- 172.21.15.86:0/4031970006 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdb7c1499b0 0x7fdb7c14a860 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fdb7800f820 tx=0x7fdb7800fbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T13:49:23.275 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:23.264+0000 7fdb71ffb700 1 -- 172.21.15.86:0/4031970006 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb780052e0 con 0x7fdb7c1499b0 2023-03-06T13:49:23.275 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:23.264+0000 7fdb71ffb700 1 -- 172.21.15.86:0/4031970006 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb78005440 con 0x7fdb7c1499b0 2023-03-06T13:49:23.275 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:23.264+0000 7fdb83397700 1 -- 172.21.15.86:0/4031970006 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb7c152cf0 con 0x7fdb7c1499b0 2023-03-06T13:49:23.275 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:23.264+0000 7fdb71ffb700 1 -- 172.21.15.86:0/4031970006 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb780038a0 con 0x7fdb7c1499b0 2023-03-06T13:49:23.276 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:23.264+0000 7fdb83397700 1 -- 172.21.15.86:0/4031970006 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb7c06e610 con 0x7fdb7c1499b0 2023-03-06T13:49:23.276 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:23.265+0000 7fdb83397700 1 -- 172.21.15.86:0/4031970006 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb7c06aae0 con 0x7fdb7c1499b0 2023-03-06T13:49:23.276 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:23.265+0000 7fdb71ffb700 1 -- 172.21.15.86:0/4031970006 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fdb78003a00 con 0x7fdb7c1499b0 2023-03-06T13:49:23.276 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:23.266+0000 7fdb71ffb700 1 --2- 172.21.15.86:0/4031970006 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7fdb600682f0 0x7fdb6006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:23.276 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:23.266+0000 7fdb71ffb700 1 -- 172.21.15.86:0/4031970006 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fdb78085b60 con 0x7fdb7c1499b0 2023-03-06T13:49:23.276 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:23.266+0000 7fdb81133700 1 --2- 172.21.15.86:0/4031970006 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7fdb600682f0 0x7fdb6006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:23.276 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:23.266+0000 7fdb81133700 1 --2- 172.21.15.86:0/4031970006 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7fdb600682f0 0x7fdb6006a7a0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fdb6c0011f0 tx=0x7fdb6c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T13:49:23.276 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:23.270+0000 7fdb71ffb700 1 -- 172.21.15.86:0/4031970006 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fdb780523c0 con 0x7fdb7c1499b0 2023-03-06T13:49:23.457 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:23.455+0000 7fdb83397700 1 -- 172.21.15.86:0/4031970006 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdb7c04e750 con 0x7fdb7c1499b0 2023-03-06T13:49:23.458 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:23.456+0000 7fdb71ffb700 1 -- 172.21.15.86:0/4031970006 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+17811 (secure 0 0 0) 0x7fdb780559e0 con 0x7fdb7c1499b0 2023-03-06T13:49:23.458 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-03-06T13:49:23.460 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":23,"fsid":"2cca6c77-50cb-47d8-a8c7-444575d01327","created":"2023-03-06T13:48:48.337369+0000","modified":"2023-03-06T13:49:14.708570+0000","last_up_change":"2023-03-06T13:48:59.782729+0000","last_in_change":"2023-03-06T13:48:50.777249+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-03-06T13:48:59.879087+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-03-06T13:49:06.686394+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-03-06T13:49:11.362997+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-03-06T13:49:12.753969+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2de68e69-e10f-49e1-a15a-8a9bfff504c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":96739},{"type":"v1","addr":"172.21.15.86:6816","nonce":96739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":96739},{"type":"v1","addr":"172.21.15.86:6819","nonce":96739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":96739},{"type":"v1","addr":"172.21.15.86:6823","nonce":96739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":96739},{"type":"v1","addr":"172.21.15.86:6821","nonce":96739}]},"public_addr":"172.21.15.86:6816/96739","cluster_addr":"172.21.15.86:6819/96739","heartbeat_back_addr":"172.21.15.86:6823/96739","heartbeat_front_addr":"172.21.15.86:6821/96739","state":["exists","up"]},{"osd":1,"uuid":"3e75c061-0de5-4742-a20d-4b5a4adb9b81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":96738},{"type":"v1","addr":"172.21.15.86:6801","nonce":96738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":96738},{"type":"v1","addr":"172.21.15.86:6803","nonce":96738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":96738},{"type":"v1","addr":"172.21.15.86:6807","nonce":96738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":96738},{"type":"v1","addr":"172.21.15.86:6805","nonce":96738}]},"public_addr":"172.21.15.86:6801/96738","cluster_addr":"172.21.15.86:6803/96738","heartbeat_back_addr":"172.21.15.86:6807/96738","heartbeat_front_addr":"172.21.15.86:6805/96738","state":["exists","up"]},{"osd":2,"uuid":"38d71bce-81c2-4e33-91e1-65efb08f2291","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":96740},{"type":"v1","addr":"172.21.15.86:6809","nonce":96740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":96740},{"type":"v1","addr":"172.21.15.86:6811","nonce":96740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6815","nonce":96740},{"type":"v1","addr":"172.21.15.86:6817","nonce":96740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":96740},{"type":"v1","addr":"172.21.15.86:6813","nonce":96740}]},"public_addr":"172.21.15.86:6809/96740","cluster_addr":"172.21.15.86:6811/96740","heartbeat_back_addr":"172.21.15.86:6817/96740","heartbeat_front_addr":"172.21.15.86:6813/96740","state":["exists","up"]},{"osd":3,"uuid":"d95a2686-21bd-4b66-9ea5-eef65403935b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":96756},{"type":"v1","addr":"172.21.15.86:6825","nonce":96756}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":96756},{"type":"v1","addr":"172.21.15.86:6827","nonce":96756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":96756},{"type":"v1","addr":"172.21.15.86:6831","nonce":96756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":96756},{"type":"v1","addr":"172.21.15.86:6829","nonce":96756}]},"public_addr":"172.21.15.86:6825/96756","cluster_addr":"172.21.15.86:6827/96756","heartbeat_back_addr":"172.21.15.86:6831/96756","heartbeat_front_addr":"172.21.15.86:6829/96756","state":["exists","up"]},{"osd":4,"uuid":"98c7e359-0f00-496a-8aaa-5472af355e48","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.202:6816","nonce":96847},{"type":"v1","addr":"172.21.15.202:6817","nonce":96847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.202:6818","nonce":96847},{"type":"v1","addr":"172.21.15.202:6819","nonce":96847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.202:6822","nonce":96847},{"type":"v1","addr":"172.21.15.202:6823","nonce":96847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.202:6820","nonce":96847},{"type":"v1","addr":"172.21.15.202:6821","nonce":96847}]},"public_addr":"172.21.15.202:6817/96847","cluster_addr":"172.21.15.202:6819/96847","heartbeat_back_addr":"172.21.15.202:6823/96847","heartbeat_front_addr":"172.21.15.202:6821/96847","state":["exists","up"]},{"osd":5,"uuid":"fa6688d9-73f3-4593-a50e-d96a0fe5f4cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.202:6824","nonce":96848},{"type":"v1","addr":"172.21.15.202:6825","nonce":96848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.202:6826","nonce":96848},{"type":"v1","addr":"172.21.15.202:6827","nonce":96848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.202:6830","nonce":96848},{"type":"v1","addr":"172.21.15.202:6831","nonce":96848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.202:6828","nonce":96848},{"type":"v1","addr":"172.21.15.202:6829","nonce":96848}]},"public_addr":"172.21.15.202:6825/96848","cluster_addr":"172.21.15.202:6827/96848","heartbeat_back_addr":"172.21.15.202:6831/96848","heartbeat_front_addr":"172.21.15.202:6829/96848","state":["exists","up"]},{"osd":6,"uuid":"7bfc6dc0-2388-4498-9cd7-766e3606f6a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.202:6808","nonce":96845},{"type":"v1","addr":"172.21.15.202:6809","nonce":96845}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.202:6810","nonce":96845},{"type":"v1","addr":"172.21.15.202:6811","nonce":96845}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.202:6814","nonce":96845},{"type":"v1","addr":"172.21.15.202:6815","nonce":96845}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.202:6812","nonce":96845},{"type":"v1","addr":"172.21.15.202:6813","nonce":96845}]},"public_addr":"172.21.15.202:6809/96845","cluster_addr":"172.21.15.202:6811/96845","heartbeat_back_addr":"172.21.15.202:6815/96845","heartbeat_front_addr":"172.21.15.202:6813/96845","state":["exists","up"]},{"osd":7,"uuid":"c475f863-96fd-48e3-8033-7d1c3b1d503f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.202:6800","nonce":96846},{"type":"v1","addr":"172.21.15.202:6801","nonce":96846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.202:6802","nonce":96846},{"type":"v1","addr":"172.21.15.202:6803","nonce":96846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.202:6806","nonce":96846},{"type":"v1","addr":"172.21.15.202:6807","nonce":96846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.202:6804","nonce":96846},{"type":"v1","addr":"172.21.15.202:6805","nonce":96846}]},"public_addr":"172.21.15.202:6801/96846","cluster_addr":"172.21.15.202:6803/96846","heartbeat_back_addr":"172.21.15.202:6807/96846","heartbeat_front_addr":"172.21.15.202:6805/96846","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-06T13:48:55.997991+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-06T13:48:55.930805+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-06T13:48:56.000312+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-06T13:48:55.998360+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-06T13:48:56.052762+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-06T13:48:56.036049+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-06T13:48:56.048751+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-06T13:48:56.011928+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-03-06T13:49:23.461 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:23.458+0000 7fdb83397700 1 -- 172.21.15.86:0/4031970006 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7fdb600682f0 msgr2=0x7fdb6006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:23.461 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:23.458+0000 7fdb83397700 1 --2- 172.21.15.86:0/4031970006 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7fdb600682f0 0x7fdb6006a7a0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fdb6c0011f0 tx=0x7fdb6c009040 comp rx=0 tx=0).stop 2023-03-06T13:49:23.461 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:23.459+0000 7fdb83397700 1 -- 172.21.15.86:0/4031970006 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdb7c1499b0 msgr2=0x7fdb7c14a860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:23.462 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:23.459+0000 7fdb83397700 1 --2- 172.21.15.86:0/4031970006 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdb7c1499b0 0x7fdb7c14a860 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fdb7800f820 tx=0x7fdb7800fbe0 comp rx=0 tx=0).stop 2023-03-06T13:49:23.462 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:23.459+0000 7fdb83397700 1 -- 172.21.15.86:0/4031970006 shutdown_connections 2023-03-06T13:49:23.462 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:23.459+0000 7fdb83397700 1 --2- 172.21.15.86:0/4031970006 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7fdb600682f0 0x7fdb6006a7a0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:23.462 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:23.459+0000 7fdb83397700 1 --2- 172.21.15.86:0/4031970006 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fdb7c145dc0 0x7fdb7c06a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:23.462 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:23.459+0000 7fdb83397700 1 --2- 172.21.15.86:0/4031970006 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7fdb68005320 0x7fdb7c14b0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:23.462 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:23.459+0000 7fdb83397700 1 --2- 172.21.15.86:0/4031970006 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdb7c1499b0 0x7fdb7c14a860 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:23.462 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:23.459+0000 7fdb83397700 1 -- 172.21.15.86:0/4031970006 >> 172.21.15.86:0/4031970006 conn(0x7fdb7c06c0d0 msgr2=0x7fdb7c0b7a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T13:49:23.463 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:23.459+0000 7fdb83397700 1 -- 172.21.15.86:0/4031970006 shutdown_connections 2023-03-06T13:49:23.463 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:23.459+0000 7fdb83397700 1 -- 172.21.15.86:0/4031970006 wait complete. 2023-03-06T13:49:23.473 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-03-06T13:48:59.879087+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-03-06T13:49:06.686394+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-03-06T13:49:11.362997+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-03-06T13:49:12.753969+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-03-06T13:49:23.474 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-03-06T13:49:23.595 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:23.593+0000 7fed24613700 1 Processor -- start 2023-03-06T13:49:23.595 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:23.593+0000 7fed24613700 1 -- start start 2023-03-06T13:49:23.597 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:23.594+0000 7fed24613700 1 --2- >> v2:172.21.15.202:3300/0 conn(0x7fed1c149420 0x7fed1c0c2860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:23.598 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:23.594+0000 7fed24613700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fed1c06ea90 0x7fed1c159a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:23.598 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:23.594+0000 7fed24613700 1 -- --> v1:172.21.15.202:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed1c153340 con 0x7fed1c0c2da0 2023-03-06T13:49:23.598 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:23.594+0000 7fed24613700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed1c1497f0 con 0x7fed1c06ea90 2023-03-06T13:49:23.598 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:23.594+0000 7fed24613700 1 -- --> v2:172.21.15.202:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed1c152750 con 0x7fed1c149420 2023-03-06T13:49:23.598 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:23.594+0000 7fed22bb0700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fed1c06ea90 0x7fed1c159a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:23.598 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:23.594+0000 7fed22bb0700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fed1c06ea90 0x7fed1c159a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:39150/0 (socket says 172.21.15.86:39150) 2023-03-06T13:49:23.599 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:23.594+0000 7fed22bb0700 1 -- 172.21.15.86:0/2133983490 learned_addr learned my addr 172.21.15.86:0/2133983490 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-03-06T13:49:23.599 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:23.594+0000 7fed223af700 1 --2- 172.21.15.86:0/2133983490 >> v2:172.21.15.202:3300/0 conn(0x7fed1c149420 0x7fed1c0c2860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:23.599 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:23.595+0000 7fed22bb0700 1 -- 172.21.15.86:0/2133983490 >> v2:172.21.15.202:3300/0 conn(0x7fed1c149420 msgr2=0x7fed1c0c2860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T13:49:23.599 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:23.595+0000 7fed22bb0700 1 --2- 172.21.15.86:0/2133983490 >> v2:172.21.15.202:3300/0 conn(0x7fed1c149420 0x7fed1c0c2860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:23.599 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:23.595+0000 7fed22bb0700 1 -- 172.21.15.86:0/2133983490 >> v1:172.21.15.202:6789/0 conn(0x7fed1c0c2da0 legacy=0x7fed1c14f0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:23.599 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:23.595+0000 7fed22bb0700 1 -- 172.21.15.86:0/2133983490 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed1c152a10 con 0x7fed1c06ea90 2023-03-06T13:49:23.600 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:23.595+0000 7fed22bb0700 1 --2- 172.21.15.86:0/2133983490 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fed1c06ea90 0x7fed1c159a40 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fed1c067e40 tx=0x7fed1400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fa8e6f91505d958 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T13:49:23.600 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:23.595+0000 7fed213ad700 1 -- 172.21.15.86:0/2133983490 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed1400e070 con 0x7fed1c06ea90 2023-03-06T13:49:23.600 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:23.595+0000 7fed213ad700 1 -- 172.21.15.86:0/2133983490 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed1400b9c0 con 0x7fed1c06ea90 2023-03-06T13:49:23.600 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:23.595+0000 7fed213ad700 1 -- 172.21.15.86:0/2133983490 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed1400bd70 con 0x7fed1c06ea90 2023-03-06T13:49:23.600 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:23.595+0000 7fed24613700 1 -- 172.21.15.86:0/2133983490 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fed1c06ea90 msgr2=0x7fed1c159a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:23.600 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:23.595+0000 7fed24613700 1 --2- 172.21.15.86:0/2133983490 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fed1c06ea90 0x7fed1c159a40 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fed1c067e40 tx=0x7fed1400b330 comp rx=0 tx=0).stop 2023-03-06T13:49:23.601 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:23.595+0000 7fed24613700 1 -- 172.21.15.86:0/2133983490 shutdown_connections 2023-03-06T13:49:23.601 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:23.595+0000 7fed24613700 1 --2- 172.21.15.86:0/2133983490 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fed1c06ea90 0x7fed1c159a40 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:23.601 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:23.595+0000 7fed24613700 1 --2- 172.21.15.86:0/2133983490 >> v2:172.21.15.202:3300/0 conn(0x7fed1c149420 0x7fed1c0c2860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:23.601 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:23.595+0000 7fed24613700 1 -- 172.21.15.86:0/2133983490 >> 172.21.15.86:0/2133983490 conn(0x7fed1c06c0d0 msgr2=0x7fed1c0c2150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T13:49:23.601 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:23.596+0000 7fed24613700 1 -- 172.21.15.86:0/2133983490 shutdown_connections 2023-03-06T13:49:23.602 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:23.596+0000 7fed24613700 1 -- 172.21.15.86:0/2133983490 wait complete. 2023-03-06T13:49:23.605 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:23.597+0000 7fed24613700 1 Processor -- start 2023-03-06T13:49:23.606 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:23.597+0000 7fed24613700 1 -- start start 2023-03-06T13:49:23.606 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:23.597+0000 7fed24613700 1 --2- >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fed1c06ea90 0x7fed1c0c0dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:23.606 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:23.597+0000 7fed24613700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fed1c0c2da0 0x7fed1c0a60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:23.606 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:23.597+0000 7fed24613700 1 --2- >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7fed1c149420 0x7fed1c0a6d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:23.607 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:23.597+0000 7fed24613700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed1c0a57c0 con 0x7fed1c0c2da0 2023-03-06T13:49:23.607 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:23.597+0000 7fed24613700 1 -- --> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed1c0c1300 con 0x7fed1c149420 2023-03-06T13:49:23.607 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:23.597+0000 7fed24613700 1 -- --> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed1c0a7d30 con 0x7fed1c06ea90 2023-03-06T13:49:23.607 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:23.597+0000 7fed21bae700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fed1c0c2da0 0x7fed1c0a60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:23.608 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:23.597+0000 7fed21bae700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fed1c0c2da0 0x7fed1c0a60e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:39152/0 (socket says 172.21.15.86:39152) 2023-03-06T13:49:23.608 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:23.597+0000 7fed21bae700 1 -- 172.21.15.86:0/2070771776 learned_addr learned my addr 172.21.15.86:0/2070771776 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-03-06T13:49:23.608 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:23.597+0000 7fed22bb0700 1 --2- 172.21.15.86:0/2070771776 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7fed1c149420 0x7fed1c0a6d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:23.608 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:23.597+0000 7fed223af700 1 --2- 172.21.15.86:0/2070771776 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fed1c06ea90 0x7fed1c0c0dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:23.609 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:23.598+0000 7fed21bae700 1 -- 172.21.15.86:0/2070771776 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fed1c06ea90 msgr2=0x7fed1c0c0dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:23.609 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:23.598+0000 7fed21bae700 1 --2- 172.21.15.86:0/2070771776 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fed1c06ea90 0x7fed1c0c0dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:23.609 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:23.598+0000 7fed21bae700 1 -- 172.21.15.86:0/2070771776 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7fed1c149420 msgr2=0x7fed1c0a6d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:23.609 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:23.598+0000 7fed21bae700 1 --2- 172.21.15.86:0/2070771776 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7fed1c149420 0x7fed1c0a6d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:23.610 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:23.598+0000 7fed21bae700 1 -- 172.21.15.86:0/2070771776 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed14009b30 con 0x7fed1c0c2da0 2023-03-06T13:49:23.610 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:23.598+0000 7fed21bae700 1 --2- 172.21.15.86:0/2070771776 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fed1c0c2da0 0x7fed1c0a60e0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fed1800c4e0 tx=0x7fed1800c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T13:49:23.610 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:23.598+0000 7fed12ffd700 1 -- 172.21.15.86:0/2070771776 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed180052d0 con 0x7fed1c0c2da0 2023-03-06T13:49:23.610 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:23.598+0000 7fed12ffd700 1 -- 172.21.15.86:0/2070771776 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed18005430 con 0x7fed1c0c2da0 2023-03-06T13:49:23.611 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:23.598+0000 7fed24613700 1 -- 172.21.15.86:0/2070771776 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed1c152fd0 con 0x7fed1c0c2da0 2023-03-06T13:49:23.611 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:23.598+0000 7fed12ffd700 1 -- 172.21.15.86:0/2070771776 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed180038c0 con 0x7fed1c0c2da0 2023-03-06T13:49:23.611 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:23.598+0000 7fed24613700 1 -- 172.21.15.86:0/2070771776 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed1c152cf0 con 0x7fed1c0c2da0 2023-03-06T13:49:23.611 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:23.599+0000 7fed24613700 1 -- 172.21.15.86:0/2070771776 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed1c06e610 con 0x7fed1c0c2da0 2023-03-06T13:49:23.611 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:23.599+0000 7fed12ffd700 1 -- 172.21.15.86:0/2070771776 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fed18019030 con 0x7fed1c0c2da0 2023-03-06T13:49:23.611 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:23.600+0000 7fed12ffd700 1 --2- 172.21.15.86:0/2070771776 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7fed000682f0 0x7fed0006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:23.611 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:23.600+0000 7fed223af700 1 --2- 172.21.15.86:0/2070771776 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7fed000682f0 0x7fed0006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:23.612 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:23.600+0000 7fed12ffd700 1 -- 172.21.15.86:0/2070771776 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fed18084e50 con 0x7fed1c0c2da0 2023-03-06T13:49:23.612 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:23.600+0000 7fed223af700 1 --2- 172.21.15.86:0/2070771776 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7fed000682f0 0x7fed0006a7a0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fed0c006b20 tx=0x7fed0c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T13:49:23.612 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:23.604+0000 7fed12ffd700 1 -- 172.21.15.86:0/2070771776 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fed180516b0 con 0x7fed1c0c2da0 2023-03-06T13:49:23.788 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:23.785+0000 7fed24613700 1 -- 172.21.15.86:0/2070771776 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fed1c04e750 con 0x7fed1c0c2da0 2023-03-06T13:49:23.788 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:23.786+0000 7fed12ffd700 1 -- 172.21.15.86:0/2070771776 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7fed180170a0 con 0x7fed1c0c2da0 2023-03-06T13:49:23.788 INFO:teuthology.orchestra.run.smithi086.stdout:pg_num: 1 2023-03-06T13:49:23.791 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:23.788+0000 7fed24613700 1 -- 172.21.15.86:0/2070771776 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7fed000682f0 msgr2=0x7fed0006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:23.791 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:23.788+0000 7fed24613700 1 --2- 172.21.15.86:0/2070771776 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7fed000682f0 0x7fed0006a7a0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fed0c006b20 tx=0x7fed0c008040 comp rx=0 tx=0).stop 2023-03-06T13:49:23.791 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:23.788+0000 7fed24613700 1 -- 172.21.15.86:0/2070771776 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fed1c0c2da0 msgr2=0x7fed1c0a60e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:23.791 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:23.788+0000 7fed24613700 1 --2- 172.21.15.86:0/2070771776 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fed1c0c2da0 0x7fed1c0a60e0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fed1800c4e0 tx=0x7fed1800c7f0 comp rx=0 tx=0).stop 2023-03-06T13:49:23.792 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:23.788+0000 7fed24613700 1 -- 172.21.15.86:0/2070771776 shutdown_connections 2023-03-06T13:49:23.792 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:23.788+0000 7fed24613700 1 --2- 172.21.15.86:0/2070771776 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7fed000682f0 0x7fed0006a7a0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:23.792 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:23.788+0000 7fed24613700 1 --2- 172.21.15.86:0/2070771776 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7fed1c149420 0x7fed1c0a6d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:23.792 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:23.788+0000 7fed24613700 1 --2- 172.21.15.86:0/2070771776 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7fed1c06ea90 0x7fed1c0c0dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:23.792 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:23.788+0000 7fed24613700 1 --2- 172.21.15.86:0/2070771776 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fed1c0c2da0 0x7fed1c0a60e0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:23.793 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:23.788+0000 7fed24613700 1 -- 172.21.15.86:0/2070771776 >> 172.21.15.86:0/2070771776 conn(0x7fed1c06c0d0 msgr2=0x7fed1c0befa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T13:49:23.793 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:23.788+0000 7fed24613700 1 -- 172.21.15.86:0/2070771776 shutdown_connections 2023-03-06T13:49:23.793 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:23.788+0000 7fed24613700 1 -- 172.21.15.86:0/2070771776 wait complete. 2023-03-06T13:49:23.802 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-03-06T13:49:23.925 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:23.923+0000 7f5ab9eaf700 1 Processor -- start 2023-03-06T13:49:23.925 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:23.923+0000 7f5ab9eaf700 1 -- start start 2023-03-06T13:49:23.927 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:23.924+0000 7f5ab9eaf700 1 --2- >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f5ab414fe60 0x7f5ab40c2c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:23.927 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:23.924+0000 7f5ab9eaf700 1 --2- >> v2:172.21.15.202:3300/0 conn(0x7f5ab40bd220 0x7f5ab4156770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:23.927 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:23.924+0000 7f5ab9eaf700 1 -- --> v1:172.21.15.202:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ab4146310 con 0x7f5ab40c2860 2023-03-06T13:49:23.927 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:23.924+0000 7f5ab9eaf700 1 -- --> v2:172.21.15.202:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ab406d420 con 0x7f5ab40bd220 2023-03-06T13:49:23.927 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:23.924+0000 7f5ab9eaf700 1 -- --> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ab414cc50 con 0x7f5ab414fe60 2023-03-06T13:49:23.927 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:23.924+0000 7f5ab2ffd700 1 --2- >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f5ab414fe60 0x7f5ab40c2c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:23.928 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:23.924+0000 7f5ab3fff700 1 --2- >> v2:172.21.15.202:3300/0 conn(0x7f5ab40bd220 0x7f5ab4156770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:23.928 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:23.924+0000 7f5ab2ffd700 1 --2- >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f5ab414fe60 0x7f5ab40c2c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.202:3301/0 says I am v2:172.21.15.86:50856/0 (socket says 172.21.15.86:50856) 2023-03-06T13:49:23.928 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:23.924+0000 7f5ab2ffd700 1 -- 172.21.15.86:0/2216196993 learned_addr learned my addr 172.21.15.86:0/2216196993 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-03-06T13:49:23.928 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:23.925+0000 7f5ab2ffd700 1 -- 172.21.15.86:0/2216196993 >> v2:172.21.15.202:3300/0 conn(0x7f5ab40bd220 msgr2=0x7f5ab4156770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T13:49:23.928 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:23.925+0000 7f5ab2ffd700 1 --2- 172.21.15.86:0/2216196993 >> v2:172.21.15.202:3300/0 conn(0x7f5ab40bd220 0x7f5ab4156770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:23.928 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:23.925+0000 7f5ab2ffd700 1 -- 172.21.15.86:0/2216196993 >> v1:172.21.15.202:6789/0 conn(0x7f5ab40c2860 legacy=0x7f5ab414f750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:23.928 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:23.925+0000 7f5ab27fc700 1 -- 172.21.15.86:0/2216196993 <== mon.1 v1:172.21.15.202:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1477290657 0 0) 0x7f5aa4001110 con 0x7f5ab40c2860 2023-03-06T13:49:23.928 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:23.925+0000 7f5ab2ffd700 1 -- 172.21.15.86:0/2216196993 --> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ab40bd770 con 0x7f5ab414fe60 2023-03-06T13:49:23.929 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:23.925+0000 7f5ab2ffd700 1 --2- 172.21.15.86:0/2216196993 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f5ab414fe60 0x7f5ab40c2c30 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f5aa80098f0 tx=0x7f5aa8009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6d6acfc94935a394 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T13:49:23.929 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:23.925+0000 7f5ab27fc700 1 -- 172.21.15.86:0/2216196993 <== mon.2 v2:172.21.15.202:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5aa8011830 con 0x7f5ab414fe60 2023-03-06T13:49:23.929 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:23.925+0000 7f5ab27fc700 1 -- 172.21.15.86:0/2216196993 <== mon.2 v2:172.21.15.202:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5aa8011990 con 0x7f5ab414fe60 2023-03-06T13:49:23.929 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:23.925+0000 7f5ab27fc700 1 -- 172.21.15.86:0/2216196993 <== mon.2 v2:172.21.15.202:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5aa8011d20 con 0x7f5ab414fe60 2023-03-06T13:49:23.931 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:23.925+0000 7f5ab9eaf700 1 -- 172.21.15.86:0/2216196993 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f5ab414fe60 msgr2=0x7f5ab40c2c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:23.931 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:23.925+0000 7f5ab9eaf700 1 --2- 172.21.15.86:0/2216196993 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f5ab414fe60 0x7f5ab40c2c30 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f5aa80098f0 tx=0x7f5aa8009c00 comp rx=0 tx=0).stop 2023-03-06T13:49:23.931 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:23.925+0000 7f5ab9eaf700 1 -- 172.21.15.86:0/2216196993 shutdown_connections 2023-03-06T13:49:23.932 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:23.925+0000 7f5ab9eaf700 1 --2- 172.21.15.86:0/2216196993 >> v2:172.21.15.202:3300/0 conn(0x7f5ab40bd220 0x7f5ab4156770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:23.932 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:23.925+0000 7f5ab9eaf700 1 --2- 172.21.15.86:0/2216196993 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f5ab414fe60 0x7f5ab40c2c30 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:23.932 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:23.925+0000 7f5ab9eaf700 1 -- 172.21.15.86:0/2216196993 >> 172.21.15.86:0/2216196993 conn(0x7f5ab406c0d0 msgr2=0x7f5ab40c2150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T13:49:23.932 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:23.925+0000 7f5ab9eaf700 1 -- 172.21.15.86:0/2216196993 shutdown_connections 2023-03-06T13:49:23.932 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:23.926+0000 7f5ab9eaf700 1 -- 172.21.15.86:0/2216196993 wait complete. 2023-03-06T13:49:23.932 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:23.927+0000 7f5ab9eaf700 1 Processor -- start 2023-03-06T13:49:23.932 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:23.927+0000 7f5ab9eaf700 1 -- start start 2023-03-06T13:49:23.933 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:23.928+0000 7f5ab9eaf700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5ab40bd220 0x7f5ab40c20a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:23.933 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:23.928+0000 7f5ab9eaf700 1 --2- >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f5ab40c2860 0x7f5ab41e5fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:23.933 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:23.928+0000 7f5ab9eaf700 1 --2- >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f5ab414fe60 0x7f5ab4145490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:23.933 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:23.928+0000 7f5ab9eaf700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ab40a81a0 con 0x7f5ab40bd220 2023-03-06T13:49:23.933 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:23.928+0000 7f5ab9eaf700 1 -- --> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ab4147190 con 0x7f5ab40c2860 2023-03-06T13:49:23.933 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:23.928+0000 7f5ab9eaf700 1 -- --> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ab40c25e0 con 0x7f5ab414fe60 2023-03-06T13:49:23.933 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:23.928+0000 7f5ab37fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5ab40bd220 0x7f5ab40c20a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:23.934 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:23.928+0000 7f5ab37fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5ab40bd220 0x7f5ab40c20a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:39168/0 (socket says 172.21.15.86:39168) 2023-03-06T13:49:23.934 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:23.928+0000 7f5ab37fe700 1 -- 172.21.15.86:0/1453014999 learned_addr learned my addr 172.21.15.86:0/1453014999 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-03-06T13:49:23.934 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:23.928+0000 7f5ab3fff700 1 --2- 172.21.15.86:0/1453014999 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f5ab414fe60 0x7f5ab4145490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:23.934 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:23.928+0000 7f5ab2ffd700 1 --2- 172.21.15.86:0/1453014999 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f5ab40c2860 0x7f5ab41e5fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:23.935 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:23.928+0000 7f5ab37fe700 1 -- 172.21.15.86:0/1453014999 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f5ab414fe60 msgr2=0x7f5ab4145490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:23.935 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:23.928+0000 7f5ab37fe700 1 --2- 172.21.15.86:0/1453014999 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f5ab414fe60 0x7f5ab4145490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:23.935 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:23.928+0000 7f5ab37fe700 1 -- 172.21.15.86:0/1453014999 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f5ab40c2860 msgr2=0x7f5ab41e5fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:23.935 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:23.928+0000 7f5ab37fe700 1 --2- 172.21.15.86:0/1453014999 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f5ab40c2860 0x7f5ab41e5fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:23.935 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:23.928+0000 7f5ab37fe700 1 -- 172.21.15.86:0/1453014999 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5aa8009550 con 0x7f5ab40bd220 2023-03-06T13:49:23.935 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:23.929+0000 7f5ab37fe700 1 --2- 172.21.15.86:0/1453014999 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5ab40bd220 0x7f5ab40c20a0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f5aa400c780 tx=0x7f5aa400ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T13:49:23.935 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:23.929+0000 7f5a9bfff700 1 -- 172.21.15.86:0/1453014999 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5aa40054e0 con 0x7f5ab40bd220 2023-03-06T13:49:23.935 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:23.929+0000 7f5a9bfff700 1 -- 172.21.15.86:0/1453014999 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5aa4003680 con 0x7f5ab40bd220 2023-03-06T13:49:23.936 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:23.929+0000 7f5ab9eaf700 1 -- 172.21.15.86:0/1453014999 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ab40bdd30 con 0x7f5ab40bd220 2023-03-06T13:49:23.936 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:23.929+0000 7f5a9bfff700 1 -- 172.21.15.86:0/1453014999 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5aa4003a30 con 0x7f5ab40bd220 2023-03-06T13:49:23.936 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:23.929+0000 7f5ab9eaf700 1 -- 172.21.15.86:0/1453014999 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ab40bda50 con 0x7f5ab40bd220 2023-03-06T13:49:23.936 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:23.930+0000 7f5ab9eaf700 1 -- 172.21.15.86:0/1453014999 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ab40723b0 con 0x7f5ab40bd220 2023-03-06T13:49:23.937 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:23.930+0000 7f5a9bfff700 1 -- 172.21.15.86:0/1453014999 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f5aa4019030 con 0x7f5ab40bd220 2023-03-06T13:49:23.937 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:23.931+0000 7f5a9bfff700 1 --2- 172.21.15.86:0/1453014999 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7f5aa00682f0 0x7f5aa006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:23.937 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:23.931+0000 7f5ab2ffd700 1 --2- 172.21.15.86:0/1453014999 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7f5aa00682f0 0x7f5aa006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:23.937 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:23.931+0000 7f5a9bfff700 1 -- 172.21.15.86:0/1453014999 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5aa4084bf0 con 0x7f5ab40bd220 2023-03-06T13:49:23.937 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:23.931+0000 7f5ab2ffd700 1 --2- 172.21.15.86:0/1453014999 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7f5aa00682f0 0x7f5aa006a7a0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f5aa8000c00 tx=0x7f5aa8008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T13:49:23.937 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:23.935+0000 7f5a9bfff700 1 -- 172.21.15.86:0/1453014999 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f5aa404b5e0 con 0x7f5ab40bd220 2023-03-06T13:49:24.117 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:24.115+0000 7f5ab9eaf700 1 -- 172.21.15.86:0/1453014999 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f5ab4146310 con 0x7f5ab40bd220 2023-03-06T13:49:24.117 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:24.115+0000 7f5a9bfff700 1 -- 172.21.15.86:0/1453014999 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v23) v1 ==== 92+0+10 (secure 0 0 0) 0x7f5ab4146310 con 0x7f5ab40bd220 2023-03-06T13:49:24.117 INFO:teuthology.orchestra.run.smithi086.stdout:pg_num: 8 2023-03-06T13:49:24.119 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:24.117+0000 7f5ab9eaf700 1 -- 172.21.15.86:0/1453014999 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7f5aa00682f0 msgr2=0x7f5aa006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:24.119 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:24.117+0000 7f5ab9eaf700 1 --2- 172.21.15.86:0/1453014999 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7f5aa00682f0 0x7f5aa006a7a0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f5aa8000c00 tx=0x7f5aa8008030 comp rx=0 tx=0).stop 2023-03-06T13:49:24.120 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:24.117+0000 7f5ab9eaf700 1 -- 172.21.15.86:0/1453014999 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5ab40bd220 msgr2=0x7f5ab40c20a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:24.120 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:24.117+0000 7f5ab9eaf700 1 --2- 172.21.15.86:0/1453014999 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5ab40bd220 0x7f5ab40c20a0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f5aa400c780 tx=0x7f5aa400ca90 comp rx=0 tx=0).stop 2023-03-06T13:49:24.120 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:24.117+0000 7f5ab9eaf700 1 -- 172.21.15.86:0/1453014999 shutdown_connections 2023-03-06T13:49:24.120 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:24.117+0000 7f5ab9eaf700 1 --2- 172.21.15.86:0/1453014999 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7f5aa00682f0 0x7f5aa006a7a0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:24.120 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:24.117+0000 7f5ab9eaf700 1 --2- 172.21.15.86:0/1453014999 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5ab40bd220 0x7f5ab40c20a0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:24.120 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:24.117+0000 7f5ab9eaf700 1 --2- 172.21.15.86:0/1453014999 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f5ab414fe60 0x7f5ab4145490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:24.120 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:24.117+0000 7f5ab9eaf700 1 --2- 172.21.15.86:0/1453014999 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f5ab40c2860 0x7f5ab41e5fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:24.121 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:24.117+0000 7f5ab9eaf700 1 -- 172.21.15.86:0/1453014999 >> 172.21.15.86:0/1453014999 conn(0x7f5ab406c0d0 msgr2=0x7f5ab41d8b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T13:49:24.121 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:24.117+0000 7f5ab9eaf700 1 -- 172.21.15.86:0/1453014999 shutdown_connections 2023-03-06T13:49:24.121 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:24.117+0000 7f5ab9eaf700 1 -- 172.21.15.86:0/1453014999 wait complete. 2023-03-06T13:49:24.131 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-03-06T13:49:24.255 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:24.253+0000 7f6f7a49e700 1 Processor -- start 2023-03-06T13:49:24.256 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:24.253+0000 7f6f7a49e700 1 -- start start 2023-03-06T13:49:24.258 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:24.254+0000 7f6f7a49e700 1 --2- >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f6f740bd220 0x7f6f740c2c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:24.258 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:24.254+0000 7f6f7a49e700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f74146310 con 0x7f6f740c2860 2023-03-06T13:49:24.258 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:24.254+0000 7f6f7a49e700 1 -- --> v1:172.21.15.202:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f7406d420 con 0x7f6f7414fe60 2023-03-06T13:49:24.259 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:24.254+0000 7f6f7a49e700 1 -- --> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f7414cc50 con 0x7f6f740bd220 2023-03-06T13:49:24.259 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:24.254+0000 7f6f73fff700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f6f740c2860 0x7f6f7414f750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:49322/0 (socket says 172.21.15.86:49322) 2023-03-06T13:49:24.259 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:24.254+0000 7f6f73fff700 1 -- 172.21.15.86:0/308135724 learned_addr learned my addr 172.21.15.86:0/308135724 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-03-06T13:49:24.259 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:24.254+0000 7f6f78a3b700 1 --2- 172.21.15.86:0/308135724 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f6f740bd220 0x7f6f740c2c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:24.260 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:24.254+0000 7f6f72ffd700 1 -- 172.21.15.86:0/308135724 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 630684712 0 0) 0x7f6f68001110 con 0x7f6f740c2860 2023-03-06T13:49:24.260 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:24.254+0000 7f6f72ffd700 1 -- 172.21.15.86:0/308135724 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6f5c0035b0 con 0x7f6f740c2860 2023-03-06T13:49:24.260 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:24.254+0000 7f6f72ffd700 1 -- 172.21.15.86:0/308135724 <== mon.1 v1:172.21.15.202:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 720150693 0 0) 0x7f6f7406d420 con 0x7f6f7414fe60 2023-03-06T13:49:24.260 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:24.254+0000 7f6f72ffd700 1 -- 172.21.15.86:0/308135724 --> v1:172.21.15.202:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6f68001110 con 0x7f6f7414fe60 2023-03-06T13:49:24.260 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:24.254+0000 7f6f72ffd700 1 -- 172.21.15.86:0/308135724 <== mon.0 v1:172.21.15.86:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1665579488 0 0) 0x7f6f5c0035b0 con 0x7f6f740c2860 2023-03-06T13:49:24.260 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:24.254+0000 7f6f78a3b700 1 -- 172.21.15.86:0/308135724 >> v1:172.21.15.202:6789/0 conn(0x7f6f7414fe60 legacy=0x7f6f74154760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:24.261 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:24.254+0000 7f6f78a3b700 1 -- 172.21.15.86:0/308135724 >> v1:172.21.15.86:6789/0 conn(0x7f6f740c2860 legacy=0x7f6f7414f750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:24.261 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:24.254+0000 7f6f78a3b700 1 -- 172.21.15.86:0/308135724 --> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f740bd770 con 0x7f6f740bd220 2023-03-06T13:49:24.261 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:24.255+0000 7f6f78a3b700 1 --2- 172.21.15.86:0/308135724 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f6f740bd220 0x7f6f740c2c30 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f6f6c009dc0 tx=0x7f6f6c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=98a35b6236fe3a16 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T13:49:24.261 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:24.255+0000 7f6f72ffd700 1 -- 172.21.15.86:0/308135724 <== mon.2 v2:172.21.15.202:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f6c00e070 con 0x7f6f740bd220 2023-03-06T13:49:24.261 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:24.255+0000 7f6f72ffd700 1 -- 172.21.15.86:0/308135724 <== mon.2 v2:172.21.15.202:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f6c003a20 con 0x7f6f740bd220 2023-03-06T13:49:24.262 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:24.255+0000 7f6f72ffd700 1 -- 172.21.15.86:0/308135724 <== mon.2 v2:172.21.15.202:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f68001800 con 0x7f6f740bd220 2023-03-06T13:49:24.262 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:24.255+0000 7f6f7a49e700 1 -- 172.21.15.86:0/308135724 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f6f740bd220 msgr2=0x7f6f740c2c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:24.262 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:24.255+0000 7f6f7a49e700 1 --2- 172.21.15.86:0/308135724 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f6f740bd220 0x7f6f740c2c30 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f6f6c009dc0 tx=0x7f6f6c00b330 comp rx=0 tx=0).stop 2023-03-06T13:49:24.262 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:24.255+0000 7f6f7a49e700 1 -- 172.21.15.86:0/308135724 shutdown_connections 2023-03-06T13:49:24.262 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:24.255+0000 7f6f7a49e700 1 --2- 172.21.15.86:0/308135724 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f6f740bd220 0x7f6f740c2c30 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:24.262 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:24.255+0000 7f6f7a49e700 1 -- 172.21.15.86:0/308135724 >> 172.21.15.86:0/308135724 conn(0x7f6f7406c0d0 msgr2=0x7f6f740c2150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T13:49:24.262 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:24.255+0000 7f6f7a49e700 1 -- 172.21.15.86:0/308135724 shutdown_connections 2023-03-06T13:49:24.263 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:24.255+0000 7f6f7a49e700 1 -- 172.21.15.86:0/308135724 wait complete. 2023-03-06T13:49:24.263 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:24.257+0000 7f6f7a49e700 1 Processor -- start 2023-03-06T13:49:24.265 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:24.257+0000 7f6f7a49e700 1 -- start start 2023-03-06T13:49:24.265 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:24.257+0000 7f6f7a49e700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6f740bd220 0x7f6f740a7dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:24.266 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:24.257+0000 7f6f7a49e700 1 --2- >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f6f740c2860 0x7f6f741e5c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:24.266 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:24.257+0000 7f6f7a49e700 1 --2- >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f6f7414fe60 0x7f6f740b7770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:24.266 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:24.257+0000 7f6f7a49e700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f740a5da0 con 0x7f6f740bd220 2023-03-06T13:49:24.266 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:24.257+0000 7f6f7a49e700 1 -- --> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f740a4c10 con 0x7f6f740c2860 2023-03-06T13:49:24.266 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:24.257+0000 7f6f7a49e700 1 -- --> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f740a7930 con 0x7f6f7414fe60 2023-03-06T13:49:24.266 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:24.257+0000 7f6f73fff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6f740bd220 0x7f6f740a7dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:24.267 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:24.257+0000 7f6f73fff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6f740bd220 0x7f6f740a7dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:39180/0 (socket says 172.21.15.86:39180) 2023-03-06T13:49:24.267 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:24.258+0000 7f6f73fff700 1 -- 172.21.15.86:0/3224681179 learned_addr learned my addr 172.21.15.86:0/3224681179 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-03-06T13:49:24.267 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:24.258+0000 7f6f78a3b700 1 --2- 172.21.15.86:0/3224681179 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f6f7414fe60 0x7f6f740b7770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:24.267 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:24.258+0000 7f6f737fe700 1 --2- 172.21.15.86:0/3224681179 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f6f740c2860 0x7f6f741e5c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:24.267 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:24.258+0000 7f6f73fff700 1 -- 172.21.15.86:0/3224681179 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f6f7414fe60 msgr2=0x7f6f740b7770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:24.267 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:24.258+0000 7f6f73fff700 1 --2- 172.21.15.86:0/3224681179 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f6f7414fe60 0x7f6f740b7770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:24.267 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:24.258+0000 7f6f73fff700 1 -- 172.21.15.86:0/3224681179 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f6f740c2860 msgr2=0x7f6f741e5c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:24.267 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:24.258+0000 7f6f73fff700 1 --2- 172.21.15.86:0/3224681179 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f6f740c2860 0x7f6f741e5c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:24.268 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:24.258+0000 7f6f73fff700 1 -- 172.21.15.86:0/3224681179 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f6c009a70 con 0x7f6f740bd220 2023-03-06T13:49:24.268 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:24.258+0000 7f6f737fe700 1 --2- 172.21.15.86:0/3224681179 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f6f740c2860 0x7f6f741e5c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-06T13:49:24.268 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:24.258+0000 7f6f73fff700 1 --2- 172.21.15.86:0/3224681179 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6f740bd220 0x7f6f740a7dc0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f6f6800cad0 tx=0x7f6f6800cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T13:49:24.268 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:24.258+0000 7f6f70ff9700 1 -- 172.21.15.86:0/3224681179 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f68004a80 con 0x7f6f740bd220 2023-03-06T13:49:24.269 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:24.258+0000 7f6f70ff9700 1 -- 172.21.15.86:0/3224681179 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f68004c00 con 0x7f6f740bd220 2023-03-06T13:49:24.269 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:24.258+0000 7f6f7a49e700 1 -- 172.21.15.86:0/3224681179 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f740bdd30 con 0x7f6f740bd220 2023-03-06T13:49:24.269 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:24.258+0000 7f6f70ff9700 1 -- 172.21.15.86:0/3224681179 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f680070d0 con 0x7f6f740bd220 2023-03-06T13:49:24.269 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:24.258+0000 7f6f7a49e700 1 -- 172.21.15.86:0/3224681179 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f740bda50 con 0x7f6f740bd220 2023-03-06T13:49:24.270 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:24.259+0000 7f6f7a49e700 1 -- 172.21.15.86:0/3224681179 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f740723b0 con 0x7f6f740bd220 2023-03-06T13:49:24.270 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:24.259+0000 7f6f70ff9700 1 -- 172.21.15.86:0/3224681179 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f6f6801a030 con 0x7f6f740bd220 2023-03-06T13:49:24.270 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:24.260+0000 7f6f70ff9700 1 --2- 172.21.15.86:0/3224681179 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7f6f600682f0 0x7f6f6006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:24.270 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:24.260+0000 7f6f70ff9700 1 -- 172.21.15.86:0/3224681179 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f6f68085090 con 0x7f6f740bd220 2023-03-06T13:49:24.270 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:24.260+0000 7f6f737fe700 1 --2- 172.21.15.86:0/3224681179 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7f6f600682f0 0x7f6f6006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:24.270 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:24.260+0000 7f6f737fe700 1 --2- 172.21.15.86:0/3224681179 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7f6f600682f0 0x7f6f6006a7a0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f6f64007fd0 tx=0x7f6f64009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T13:49:24.271 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:24.264+0000 7f6f70ff9700 1 -- 172.21.15.86:0/3224681179 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f6f68051890 con 0x7f6f740bd220 2023-03-06T13:49:24.451 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:24.449+0000 7f6f7a49e700 1 -- 172.21.15.86:0/3224681179 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f6f74146310 con 0x7f6f740bd220 2023-03-06T13:49:24.452 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:24.450+0000 7f6f70ff9700 1 -- 172.21.15.86:0/3224681179 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7f6f74146310 con 0x7f6f740bd220 2023-03-06T13:49:24.452 INFO:teuthology.orchestra.run.smithi086.stdout:pg_num: 32 2023-03-06T13:49:24.454 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:24.452+0000 7f6f7a49e700 1 -- 172.21.15.86:0/3224681179 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7f6f600682f0 msgr2=0x7f6f6006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:24.454 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:24.452+0000 7f6f7a49e700 1 --2- 172.21.15.86:0/3224681179 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7f6f600682f0 0x7f6f6006a7a0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f6f64007fd0 tx=0x7f6f64009040 comp rx=0 tx=0).stop 2023-03-06T13:49:24.454 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:24.452+0000 7f6f7a49e700 1 -- 172.21.15.86:0/3224681179 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6f740bd220 msgr2=0x7f6f740a7dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:24.454 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:24.452+0000 7f6f7a49e700 1 --2- 172.21.15.86:0/3224681179 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6f740bd220 0x7f6f740a7dc0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f6f6800cad0 tx=0x7f6f6800cde0 comp rx=0 tx=0).stop 2023-03-06T13:49:24.454 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:24.452+0000 7f6f7a49e700 1 -- 172.21.15.86:0/3224681179 shutdown_connections 2023-03-06T13:49:24.454 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:24.452+0000 7f6f7a49e700 1 --2- 172.21.15.86:0/3224681179 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7f6f600682f0 0x7f6f6006a7a0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:24.455 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:24.452+0000 7f6f7a49e700 1 --2- 172.21.15.86:0/3224681179 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6f740bd220 0x7f6f740a7dc0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:24.455 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:24.452+0000 7f6f7a49e700 1 --2- 172.21.15.86:0/3224681179 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f6f7414fe60 0x7f6f740b7770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:24.455 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:24.452+0000 7f6f7a49e700 1 --2- 172.21.15.86:0/3224681179 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f6f740c2860 0x7f6f741e5c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:24.455 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:24.452+0000 7f6f7a49e700 1 -- 172.21.15.86:0/3224681179 >> 172.21.15.86:0/3224681179 conn(0x7f6f7406c0d0 msgr2=0x7f6f7414dc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T13:49:24.455 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:24.452+0000 7f6f7a49e700 1 -- 172.21.15.86:0/3224681179 shutdown_connections 2023-03-06T13:49:24.455 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:24.452+0000 7f6f7a49e700 1 -- 172.21.15.86:0/3224681179 wait complete. 2023-03-06T13:49:24.466 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-03-06T13:49:24.589 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:24.587+0000 7f3abe859700 1 Processor -- start 2023-03-06T13:49:24.589 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:24.587+0000 7f3abe859700 1 -- start start 2023-03-06T13:49:24.592 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:24.587+0000 7f3abe859700 1 --2- >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f3ab806c8e0 0x7f3ab81490f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:24.592 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:24.588+0000 7f3abe859700 1 --2- >> v2:172.21.15.202:3300/0 conn(0x7f3ab814f180 0x7f3ab8159b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:24.592 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:24.588+0000 7f3abe859700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ab806c020 con 0x7f3ab8149630 2023-03-06T13:49:24.592 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:24.588+0000 7f3abe859700 1 -- --> v2:172.21.15.202:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ab806b010 con 0x7f3ab814f180 2023-03-06T13:49:24.592 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:24.588+0000 7f3abe859700 1 -- --> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ab806b260 con 0x7f3ab806c8e0 2023-03-06T13:49:24.593 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:24.588+0000 7f3ab77fe700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f3ab8149630 0x7f3ab80c1230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:49338/0 (socket says 172.21.15.86:49338) 2023-03-06T13:49:24.593 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:24.588+0000 7f3ab77fe700 1 -- 172.21.15.86:0/736940601 learned_addr learned my addr 172.21.15.86:0/736940601 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-03-06T13:49:24.593 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:24.588+0000 7f3ab6ffd700 1 -- 172.21.15.86:0/736940601 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1091963389 0 0) 0x7f3ab806c020 con 0x7f3ab8149630 2023-03-06T13:49:24.593 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:24.588+0000 7f3ab7fff700 1 --2- 172.21.15.86:0/736940601 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f3ab806c8e0 0x7f3ab81490f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:24.593 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:24.588+0000 7f3abcdf6700 1 --2- 172.21.15.86:0/736940601 >> v2:172.21.15.202:3300/0 conn(0x7f3ab814f180 0x7f3ab8159b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:24.593 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:24.588+0000 7f3ab6ffd700 1 -- 172.21.15.86:0/736940601 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3aa00035b0 con 0x7f3ab8149630 2023-03-06T13:49:24.593 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:24.588+0000 7f3ab6ffd700 1 -- 172.21.15.86:0/736940601 <== mon.0 v1:172.21.15.86:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2076133355 0 0) 0x7f3aa00035b0 con 0x7f3ab8149630 2023-03-06T13:49:24.594 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:24.588+0000 7f3ab6ffd700 1 -- 172.21.15.86:0/736940601 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f3ab806c8e0 msgr2=0x7f3ab81490f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T13:49:24.594 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:24.588+0000 7f3ab6ffd700 1 --2- 172.21.15.86:0/736940601 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f3ab806c8e0 0x7f3ab81490f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:24.594 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:24.588+0000 7f3ab6ffd700 1 -- 172.21.15.86:0/736940601 >> v2:172.21.15.202:3300/0 conn(0x7f3ab814f180 msgr2=0x7f3ab8159b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T13:49:24.594 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:24.588+0000 7f3ab6ffd700 1 --2- 172.21.15.86:0/736940601 >> v2:172.21.15.202:3300/0 conn(0x7f3ab814f180 0x7f3ab8159b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:24.594 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:24.588+0000 7f3ab6ffd700 1 -- 172.21.15.86:0/736940601 --> v1:172.21.15.86:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ab806b540 con 0x7f3ab8149630 2023-03-06T13:49:24.594 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:24.588+0000 7f3ab6ffd700 1 -- 172.21.15.86:0/736940601 <== mon.0 v1:172.21.15.86:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2191261126 0 0) 0x7f3aac001670 con 0x7f3ab8149630 2023-03-06T13:49:24.594 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:24.588+0000 7f3ab6ffd700 1 -- 172.21.15.86:0/736940601 >> v1:172.21.15.86:6789/0 conn(0x7f3ab8149630 legacy=0x7f3ab80c1230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:24.595 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:24.588+0000 7f3ab6ffd700 1 --2- 172.21.15.86:0/736940601 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f3aa0003a00 0x7f3aa0003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:24.595 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:24.588+0000 7f3ab6ffd700 1 --2- 172.21.15.86:0/736940601 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3aa0004430 0x7f3aa00048f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:24.595 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:24.588+0000 7f3ab6ffd700 1 --2- 172.21.15.86:0/736940601 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f3ab806c8e0 0x7f3aa0005070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:24.595 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:24.588+0000 7f3ab6ffd700 1 -- 172.21.15.86:0/736940601 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ab806b010 con 0x7f3aa0004430 2023-03-06T13:49:24.595 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:24.588+0000 7f3ab6ffd700 1 -- 172.21.15.86:0/736940601 --> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ab806b260 con 0x7f3aa0003a00 2023-03-06T13:49:24.595 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:24.588+0000 7f3ab6ffd700 1 -- 172.21.15.86:0/736940601 --> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3aa000ba10 con 0x7f3ab806c8e0 2023-03-06T13:49:24.595 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:24.588+0000 7f3ab77fe700 1 --2- 172.21.15.86:0/736940601 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3aa0004430 0x7f3aa00048f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:24.595 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:24.588+0000 7f3ab7fff700 1 --2- 172.21.15.86:0/736940601 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f3aa0003a00 0x7f3aa0003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:24.596 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:24.588+0000 7f3abcdf6700 1 --2- 172.21.15.86:0/736940601 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f3ab806c8e0 0x7f3aa0005070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:24.596 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:24.589+0000 7f3ab77fe700 1 -- 172.21.15.86:0/736940601 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f3ab806c8e0 msgr2=0x7f3aa0005070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T13:49:24.596 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:24.589+0000 7f3ab77fe700 1 --2- 172.21.15.86:0/736940601 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f3ab806c8e0 0x7f3aa0005070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:24.596 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:24.589+0000 7f3ab77fe700 1 -- 172.21.15.86:0/736940601 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f3aa0003a00 msgr2=0x7f3aa0003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T13:49:24.596 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:24.589+0000 7f3ab77fe700 1 --2- 172.21.15.86:0/736940601 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f3aa0003a00 0x7f3aa0003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:24.596 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:24.589+0000 7f3ab77fe700 1 -- 172.21.15.86:0/736940601 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3aa00035b0 con 0x7f3aa0004430 2023-03-06T13:49:24.596 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:24.589+0000 7f3ab7fff700 1 --2- 172.21.15.86:0/736940601 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f3aa0003a00 0x7f3aa0003e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-06T13:49:24.596 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:24.589+0000 7f3ab77fe700 1 --2- 172.21.15.86:0/736940601 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3aa0004430 0x7f3aa00048f0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f3ab8149a40 tx=0x7f3aa0005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ac58432afc067fc server_cookie=0 in_seq=0 out_seq=0 2023-03-06T13:49:24.597 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:24.589+0000 7f3ab6ffd700 1 -- 172.21.15.86:0/736940601 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3aac007c40 con 0x7f3aa0004430 2023-03-06T13:49:24.597 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:24.589+0000 7f3ab6ffd700 1 -- 172.21.15.86:0/736940601 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3aac00ce00 con 0x7f3aa0004430 2023-03-06T13:49:24.597 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:24.589+0000 7f3ab6ffd700 1 -- 172.21.15.86:0/736940601 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3aac005ba0 con 0x7f3aa0004430 2023-03-06T13:49:24.597 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:24.589+0000 7f3abe859700 1 -- 172.21.15.86:0/736940601 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3aa0004430 msgr2=0x7f3aa00048f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:24.597 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:24.589+0000 7f3abe859700 1 --2- 172.21.15.86:0/736940601 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3aa0004430 0x7f3aa00048f0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f3ab8149a40 tx=0x7f3aa0005880 comp rx=0 tx=0).stop 2023-03-06T13:49:24.597 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:24.589+0000 7f3abcdf6700 1 -- 172.21.15.86:0/736940601 reap_dead start 2023-03-06T13:49:24.597 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:24.589+0000 7f3abe859700 1 -- 172.21.15.86:0/736940601 shutdown_connections 2023-03-06T13:49:24.598 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:24.589+0000 7f3abe859700 1 -- 172.21.15.86:0/736940601 >> 172.21.15.86:0/736940601 conn(0x7f3ab80a7060 msgr2=0x7f3ab80a7460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T13:49:24.598 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:24.589+0000 7f3abe859700 1 -- 172.21.15.86:0/736940601 shutdown_connections 2023-03-06T13:49:24.598 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:24.590+0000 7f3abe859700 1 -- 172.21.15.86:0/736940601 wait complete. 2023-03-06T13:49:24.600 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:24.591+0000 7f3abe859700 1 Processor -- start 2023-03-06T13:49:24.600 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:24.591+0000 7f3abe859700 1 -- start start 2023-03-06T13:49:24.600 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:24.591+0000 7f3abe859700 1 --2- >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f3aa0004430 0x7f3ab80ab0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:24.601 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:24.591+0000 7f3abe859700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3ab80a9650 0x7f3ab80bf1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:24.601 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:24.591+0000 7f3abe859700 1 --2- >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f3ab81e8a90 0x7f3ab80bb400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:24.601 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:24.591+0000 7f3abe859700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ab81531e0 con 0x7f3ab80a9650 2023-03-06T13:49:24.601 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:24.591+0000 7f3abe859700 1 -- --> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ab80a8400 con 0x7f3aa0004430 2023-03-06T13:49:24.601 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:24.591+0000 7f3abe859700 1 -- --> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ab81e93b0 con 0x7f3ab81e8a90 2023-03-06T13:49:24.601 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:24.591+0000 7f3ab77fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3ab80a9650 0x7f3ab80bf1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:24.601 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:24.591+0000 7f3ab77fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3ab80a9650 0x7f3ab80bf1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:39202/0 (socket says 172.21.15.86:39202) 2023-03-06T13:49:24.602 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:24.591+0000 7f3ab77fe700 1 -- 172.21.15.86:0/3605049347 learned_addr learned my addr 172.21.15.86:0/3605049347 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-03-06T13:49:24.602 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:24.592+0000 7f3ab7fff700 1 --2- 172.21.15.86:0/3605049347 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f3aa0004430 0x7f3ab80ab0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:24.602 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:24.592+0000 7f3abcdf6700 1 --2- 172.21.15.86:0/3605049347 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f3ab81e8a90 0x7f3ab80bb400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:24.602 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:24.592+0000 7f3ab77fe700 1 -- 172.21.15.86:0/3605049347 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f3ab81e8a90 msgr2=0x7f3ab80bb400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:24.602 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:24.592+0000 7f3ab77fe700 1 --2- 172.21.15.86:0/3605049347 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f3ab81e8a90 0x7f3ab80bb400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:24.602 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:24.592+0000 7f3ab77fe700 1 -- 172.21.15.86:0/3605049347 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f3aa0004430 msgr2=0x7f3ab80ab0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:24.602 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:24.592+0000 7f3ab77fe700 1 --2- 172.21.15.86:0/3605049347 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f3aa0004430 0x7f3ab80ab0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:24.602 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:24.592+0000 7f3ab77fe700 1 -- 172.21.15.86:0/3605049347 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ab806bb00 con 0x7f3ab80a9650 2023-03-06T13:49:24.603 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:24.592+0000 7f3ab7fff700 1 --2- 172.21.15.86:0/3605049347 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f3aa0004430 0x7f3ab80ab0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-06T13:49:24.603 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:24.592+0000 7f3ab77fe700 1 --2- 172.21.15.86:0/3605049347 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3ab80a9650 0x7f3ab80bf1c0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f3aac001930 tx=0x7f3ab814f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T13:49:24.603 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:24.592+0000 7f3ab4ff9700 1 -- 172.21.15.86:0/3605049347 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3aac0070d0 con 0x7f3ab80a9650 2023-03-06T13:49:24.603 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:24.592+0000 7f3ab4ff9700 1 -- 172.21.15.86:0/3605049347 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3aac007250 con 0x7f3ab80a9650 2023-03-06T13:49:24.603 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:24.592+0000 7f3abe859700 1 -- 172.21.15.86:0/3605049347 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ab806b820 con 0x7f3ab80a9650 2023-03-06T13:49:24.603 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:24.592+0000 7f3ab4ff9700 1 -- 172.21.15.86:0/3605049347 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3aac007600 con 0x7f3ab80a9650 2023-03-06T13:49:24.603 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:24.592+0000 7f3abe859700 1 -- 172.21.15.86:0/3605049347 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ab80c3290 con 0x7f3ab80a9650 2023-03-06T13:49:24.604 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:24.593+0000 7f3abe859700 1 -- 172.21.15.86:0/3605049347 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ab80a8aa0 con 0x7f3ab80a9650 2023-03-06T13:49:24.604 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:24.594+0000 7f3ab4ff9700 1 -- 172.21.15.86:0/3605049347 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f3aac024030 con 0x7f3ab80a9650 2023-03-06T13:49:24.604 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:24.594+0000 7f3ab4ff9700 1 --2- 172.21.15.86:0/3605049347 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7f3aa40682f0 0x7f3aa406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:24.604 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:24.594+0000 7f3ab4ff9700 1 -- 172.21.15.86:0/3605049347 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3aac086fc0 con 0x7f3ab80a9650 2023-03-06T13:49:24.604 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:24.594+0000 7f3ab7fff700 1 --2- 172.21.15.86:0/3605049347 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7f3aa40682f0 0x7f3aa406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:24.604 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:24.595+0000 7f3ab7fff700 1 --2- 172.21.15.86:0/3605049347 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7f3aa40682f0 0x7f3aa406a7a0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f3aa8009a70 tx=0x7f3aa8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T13:49:24.604 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:24.598+0000 7f3ab4ff9700 1 -- 172.21.15.86:0/3605049347 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f3aac0538c0 con 0x7f3ab80a9650 2023-03-06T13:49:24.782 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:24.780+0000 7f3abe859700 1 -- 172.21.15.86:0/3605049347 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f3ab80a8aa0 con 0x7f3ab80a9650 2023-03-06T13:49:24.783 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:24.780+0000 7f3ab4ff9700 1 -- 172.21.15.86:0/3605049347 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7f3ab80a8aa0 con 0x7f3ab80a9650 2023-03-06T13:49:24.783 INFO:teuthology.orchestra.run.smithi086.stdout:pg_num: 64 2023-03-06T13:49:24.784 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:24.782+0000 7f3abe859700 1 -- 172.21.15.86:0/3605049347 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7f3aa40682f0 msgr2=0x7f3aa406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:24.785 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:24.782+0000 7f3abe859700 1 --2- 172.21.15.86:0/3605049347 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7f3aa40682f0 0x7f3aa406a7a0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f3aa8009a70 tx=0x7f3aa8008040 comp rx=0 tx=0).stop 2023-03-06T13:49:24.785 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:24.782+0000 7f3abe859700 1 -- 172.21.15.86:0/3605049347 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3ab80a9650 msgr2=0x7f3ab80bf1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:24.785 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:24.782+0000 7f3abe859700 1 --2- 172.21.15.86:0/3605049347 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3ab80a9650 0x7f3ab80bf1c0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f3aac001930 tx=0x7f3ab814f690 comp rx=0 tx=0).stop 2023-03-06T13:49:24.785 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:24.782+0000 7f3abe859700 1 -- 172.21.15.86:0/3605049347 shutdown_connections 2023-03-06T13:49:24.786 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:24.782+0000 7f3abe859700 1 --2- 172.21.15.86:0/3605049347 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7f3aa40682f0 0x7f3aa406a7a0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:24.786 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:24.782+0000 7f3abe859700 1 --2- 172.21.15.86:0/3605049347 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f3ab81e8a90 0x7f3ab80bb400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:24.786 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:24.782+0000 7f3abe859700 1 --2- 172.21.15.86:0/3605049347 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f3aa0004430 0x7f3ab80ab0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:24.787 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:24.782+0000 7f3abe859700 1 --2- 172.21.15.86:0/3605049347 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3ab80a9650 0x7f3ab80bf1c0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:24.787 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:24.782+0000 7f3abe859700 1 -- 172.21.15.86:0/3605049347 >> 172.21.15.86:0/3605049347 conn(0x7f3ab80a7060 msgr2=0x7f3ab80a7460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T13:49:24.787 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:24.782+0000 7f3abe859700 1 -- 172.21.15.86:0/3605049347 shutdown_connections 2023-03-06T13:49:24.787 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:24.782+0000 7f3abe859700 1 -- 172.21.15.86:0/3605049347 wait complete. 2023-03-06T13:49:24.796 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-03-06T13:49:24.916 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:24.914+0000 7f4eda582700 1 Processor -- start 2023-03-06T13:49:24.916 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:24.914+0000 7f4eda582700 1 -- start start 2023-03-06T13:49:24.918 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:24.915+0000 7f4eda582700 1 --2- >> v2:172.21.15.202:3300/0 conn(0x7f4ed4149420 0x7f4ed40c2860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:24.918 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:24.915+0000 7f4eda582700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f4ed406ea90 0x7f4ed4159a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:24.919 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:24.915+0000 7f4eda582700 1 -- --> v1:172.21.15.202:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ed4153340 con 0x7f4ed40c2da0 2023-03-06T13:49:24.919 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:24.915+0000 7f4eda582700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ed41497f0 con 0x7f4ed406ea90 2023-03-06T13:49:24.919 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:24.915+0000 7f4eda582700 1 -- --> v2:172.21.15.202:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ed4152750 con 0x7f4ed4149420 2023-03-06T13:49:24.919 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:24.915+0000 7f4ed8b1f700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f4ed406ea90 0x7f4ed4159a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:24.919 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:24.915+0000 7f4ed8b1f700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f4ed406ea90 0x7f4ed4159a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:39212/0 (socket says 172.21.15.86:39212) 2023-03-06T13:49:24.919 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:24.915+0000 7f4ed8b1f700 1 -- 172.21.15.86:0/3811612229 learned_addr learned my addr 172.21.15.86:0/3811612229 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-03-06T13:49:24.919 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:24.915+0000 7f4ed3fff700 1 --2- 172.21.15.86:0/3811612229 >> v2:172.21.15.202:3300/0 conn(0x7f4ed4149420 0x7f4ed40c2860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:24.920 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:24.915+0000 7f4ed8b1f700 1 -- 172.21.15.86:0/3811612229 >> v2:172.21.15.202:3300/0 conn(0x7f4ed4149420 msgr2=0x7f4ed40c2860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T13:49:24.920 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:24.915+0000 7f4ed8b1f700 1 --2- 172.21.15.86:0/3811612229 >> v2:172.21.15.202:3300/0 conn(0x7f4ed4149420 0x7f4ed40c2860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:24.920 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:24.915+0000 7f4ed8b1f700 1 -- 172.21.15.86:0/3811612229 >> v1:172.21.15.202:6789/0 conn(0x7f4ed40c2da0 legacy=0x7f4ed414f0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T13:49:24.920 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:24.915+0000 7f4ed8b1f700 1 -- 172.21.15.86:0/3811612229 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ed4152a10 con 0x7f4ed406ea90 2023-03-06T13:49:24.920 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:24.915+0000 7f4ed8b1f700 1 --2- 172.21.15.86:0/3811612229 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4ed406ea90 0x7f4ed4159a40 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f4ed4067e40 tx=0x7f4ecc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e2e386c003d4c7b server_cookie=0 in_seq=0 out_seq=0 2023-03-06T13:49:24.920 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:24.915+0000 7f4ed2ffd700 1 -- 172.21.15.86:0/3811612229 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ecc00e070 con 0x7f4ed406ea90 2023-03-06T13:49:24.920 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:24.915+0000 7f4ed2ffd700 1 -- 172.21.15.86:0/3811612229 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ecc003a20 con 0x7f4ed406ea90 2023-03-06T13:49:24.921 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:24.916+0000 7f4ed2ffd700 1 -- 172.21.15.86:0/3811612229 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ecc003dd0 con 0x7f4ed406ea90 2023-03-06T13:49:24.921 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:24.916+0000 7f4eda582700 1 -- 172.21.15.86:0/3811612229 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4ed406ea90 msgr2=0x7f4ed4159a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:24.921 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:24.916+0000 7f4eda582700 1 --2- 172.21.15.86:0/3811612229 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4ed406ea90 0x7f4ed4159a40 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f4ed4067e40 tx=0x7f4ecc00b330 comp rx=0 tx=0).stop 2023-03-06T13:49:24.921 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:24.916+0000 7f4eda582700 1 -- 172.21.15.86:0/3811612229 shutdown_connections 2023-03-06T13:49:24.921 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:24.916+0000 7f4eda582700 1 --2- 172.21.15.86:0/3811612229 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4ed406ea90 0x7f4ed4159a40 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:24.921 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:24.916+0000 7f4eda582700 1 --2- 172.21.15.86:0/3811612229 >> v2:172.21.15.202:3300/0 conn(0x7f4ed4149420 0x7f4ed40c2860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:24.921 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:24.916+0000 7f4eda582700 1 -- 172.21.15.86:0/3811612229 >> 172.21.15.86:0/3811612229 conn(0x7f4ed406c0d0 msgr2=0x7f4ed40c2150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T13:49:24.922 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:24.916+0000 7f4eda582700 1 -- 172.21.15.86:0/3811612229 shutdown_connections 2023-03-06T13:49:24.922 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:24.916+0000 7f4eda582700 1 -- 172.21.15.86:0/3811612229 wait complete. 2023-03-06T13:49:24.924 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:24.917+0000 7f4eda582700 1 Processor -- start 2023-03-06T13:49:24.924 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:24.917+0000 7f4eda582700 1 -- start start 2023-03-06T13:49:24.924 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:24.918+0000 7f4eda582700 1 --2- >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f4ed406ea90 0x7f4ed40c09c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:24.924 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:24.918+0000 7f4eda582700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4ed40c2da0 0x7f4ed40c17e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:24.924 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:24.918+0000 7f4eda582700 1 --2- >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f4ed4149420 0x7f4ed41467f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:24.925 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:24.918+0000 7f4eda582700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ed414c850 con 0x7f4ed40c2da0 2023-03-06T13:49:24.925 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:24.918+0000 7f4eda582700 1 -- --> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ed414be00 con 0x7f4ed406ea90 2023-03-06T13:49:24.925 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:24.918+0000 7f4eda582700 1 -- --> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ed414c270 con 0x7f4ed4149420 2023-03-06T13:49:24.925 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:24.918+0000 7f4ed37fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4ed40c2da0 0x7f4ed40c17e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:24.925 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:24.918+0000 7f4ed37fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4ed40c2da0 0x7f4ed40c17e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:39216/0 (socket says 172.21.15.86:39216) 2023-03-06T13:49:24.925 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:24.918+0000 7f4ed37fe700 1 -- 172.21.15.86:0/2762498525 learned_addr learned my addr 172.21.15.86:0/2762498525 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-03-06T13:49:24.925 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:24.918+0000 7f4ed3fff700 1 --2- 172.21.15.86:0/2762498525 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f4ed406ea90 0x7f4ed40c09c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:24.926 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:24.918+0000 7f4ed8b1f700 1 --2- 172.21.15.86:0/2762498525 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f4ed4149420 0x7f4ed41467f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:24.926 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:24.918+0000 7f4ed37fe700 1 -- 172.21.15.86:0/2762498525 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f4ed4149420 msgr2=0x7f4ed41467f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:24.926 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:24.918+0000 7f4ed37fe700 1 --2- 172.21.15.86:0/2762498525 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f4ed4149420 0x7f4ed41467f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:24.926 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:24.918+0000 7f4ed37fe700 1 -- 172.21.15.86:0/2762498525 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f4ed406ea90 msgr2=0x7f4ed40c09c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:24.926 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:24.918+0000 7f4ed37fe700 1 --2- 172.21.15.86:0/2762498525 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f4ed406ea90 0x7f4ed40c09c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:24.926 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:24.918+0000 7f4ed37fe700 1 -- 172.21.15.86:0/2762498525 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ecc009b30 con 0x7f4ed40c2da0 2023-03-06T13:49:24.926 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:24.918+0000 7f4ed8b1f700 1 --2- 172.21.15.86:0/2762498525 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f4ed4149420 0x7f4ed41467f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-06T13:49:24.927 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:24.918+0000 7f4ed3fff700 1 --2- 172.21.15.86:0/2762498525 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f4ed406ea90 0x7f4ed40c09c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-06T13:49:24.927 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:24.918+0000 7f4ed37fe700 1 --2- 172.21.15.86:0/2762498525 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4ed40c2da0 0x7f4ed40c17e0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f4ec400c4d0 tx=0x7f4ec400c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T13:49:24.927 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:24.919+0000 7f4ed0ff9700 1 -- 172.21.15.86:0/2762498525 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ec4011790 con 0x7f4ed40c2da0 2023-03-06T13:49:24.927 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:24.919+0000 7f4ed0ff9700 1 -- 172.21.15.86:0/2762498525 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ec40118f0 con 0x7f4ed40c2da0 2023-03-06T13:49:24.927 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:24.919+0000 7f4eda582700 1 -- 172.21.15.86:0/2762498525 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ed4152fd0 con 0x7f4ed40c2da0 2023-03-06T13:49:24.927 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:24.919+0000 7f4ed0ff9700 1 -- 172.21.15.86:0/2762498525 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ec4011ca0 con 0x7f4ed40c2da0 2023-03-06T13:49:24.927 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:24.919+0000 7f4eda582700 1 -- 172.21.15.86:0/2762498525 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ed4152cf0 con 0x7f4ed40c2da0 2023-03-06T13:49:24.928 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:24.919+0000 7f4eda582700 1 -- 172.21.15.86:0/2762498525 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ed406e610 con 0x7f4ed40c2da0 2023-03-06T13:49:24.928 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:24.920+0000 7f4ed0ff9700 1 -- 172.21.15.86:0/2762498525 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f4ec4010050 con 0x7f4ed40c2da0 2023-03-06T13:49:24.928 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:24.920+0000 7f4ed0ff9700 1 --2- 172.21.15.86:0/2762498525 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7f4eb40682f0 0x7f4eb406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:24.928 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:24.920+0000 7f4ed0ff9700 1 -- 172.21.15.86:0/2762498525 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f4ec4085990 con 0x7f4ed40c2da0 2023-03-06T13:49:24.928 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:24.920+0000 7f4ed3fff700 1 --2- 172.21.15.86:0/2762498525 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7f4eb40682f0 0x7f4eb406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:24.928 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:24.921+0000 7f4ed3fff700 1 --2- 172.21.15.86:0/2762498525 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7f4eb40682f0 0x7f4eb406a7a0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f4ebc007a50 tx=0x7f4ebc008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T13:49:24.929 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:24.925+0000 7f4ed0ff9700 1 -- 172.21.15.86:0/2762498525 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f4ec40521f0 con 0x7f4ed40c2da0 2023-03-06T13:49:25.149 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.147+0000 7f4eda582700 1 -- 172.21.15.86:0/2762498525 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4ed4146d30 con 0x7f4ed40c2da0 2023-03-06T13:49:25.150 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.148+0000 7f4ed0ff9700 1 -- 172.21.15.86:0/2762498525 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4642 (secure 0 0 0) 0x7f4ec4055810 con 0x7f4ed40c2da0 2023-03-06T13:49:25.150 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-03-06T13:49:25.150 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4262,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.202:6835/1375345216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.202:6833","nonce":1375345216},{"type":"v1","addr":"172.21.15.202:6835","nonce":1375345216}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4275,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6835/3217070924","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":3217070924},{"type":"v1","addr":"172.21.15.86:6835","nonce":3217070924}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4278,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/249061809","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6836","nonce":249061809},{"type":"v1","addr":"172.21.15.86:6837","nonce":249061809}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-03-06T13:49:13.706653+0000","modified":"2023-03-06T13:49:16.718544+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4300},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4300":{"gid":4300,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.202:6834/142821572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.202:6832","nonce":142821572},{"type":"v1","addr":"172.21.15.202:6834","nonce":142821572}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-03-06T13:49:25.152 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.150+0000 7f4eda582700 1 -- 172.21.15.86:0/2762498525 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7f4eb40682f0 msgr2=0x7f4eb406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:25.152 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.150+0000 7f4eda582700 1 --2- 172.21.15.86:0/2762498525 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7f4eb40682f0 0x7f4eb406a7a0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f4ebc007a50 tx=0x7f4ebc008040 comp rx=0 tx=0).stop 2023-03-06T13:49:25.153 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.150+0000 7f4eda582700 1 -- 172.21.15.86:0/2762498525 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4ed40c2da0 msgr2=0x7f4ed40c17e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:25.153 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.150+0000 7f4eda582700 1 --2- 172.21.15.86:0/2762498525 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4ed40c2da0 0x7f4ed40c17e0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f4ec400c4d0 tx=0x7f4ec400c890 comp rx=0 tx=0).stop 2023-03-06T13:49:25.153 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.150+0000 7f4eda582700 1 -- 172.21.15.86:0/2762498525 shutdown_connections 2023-03-06T13:49:25.153 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.150+0000 7f4eda582700 1 --2- 172.21.15.86:0/2762498525 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7f4eb40682f0 0x7f4eb406a7a0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:25.153 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.150+0000 7f4eda582700 1 --2- 172.21.15.86:0/2762498525 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f4ed4149420 0x7f4ed41467f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:25.153 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.150+0000 7f4eda582700 1 --2- 172.21.15.86:0/2762498525 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f4ed406ea90 0x7f4ed40c09c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:25.153 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.150+0000 7f4eda582700 1 --2- 172.21.15.86:0/2762498525 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4ed40c2da0 0x7f4ed40c17e0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:25.154 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.150+0000 7f4eda582700 1 -- 172.21.15.86:0/2762498525 >> 172.21.15.86:0/2762498525 conn(0x7f4ed406c0d0 msgr2=0x7f4ed4150920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T13:49:25.154 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.150+0000 7f4eda582700 1 -- 172.21.15.86:0/2762498525 shutdown_connections 2023-03-06T13:49:25.154 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.150+0000 7f4eda582700 1 -- 172.21.15.86:0/2762498525 wait complete. 2023-03-06T13:49:25.154 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 8 2023-03-06T13:49:25.567 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-03-06T13:49:13.706653+0000', 'modified': '2023-03-06T13:49:16.718544+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4300}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4300': {'gid': 4300, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.202:6834/142821572', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.202:6832', 'nonce': 142821572}, {'type': 'v1', 'addr': '172.21.15.202:6834', 'nonce': 142821572}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-03-06T13:49:25.568 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-03-06T13:49:25.568 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-03-06T13:49:25.695 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.691+0000 7f702e26f700 1 Processor -- start 2023-03-06T13:49:25.696 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.691+0000 7f702e26f700 1 -- start start 2023-03-06T13:49:25.696 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.692+0000 7f702e26f700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f702806a330 0x7f70280bd8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:25.696 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.692+0000 7f702e26f700 1 --2- >> v2:172.21.15.202:3300/0 conn(0x7f702806e950 0x7f702806a700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:25.696 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.692+0000 7f702e26f700 1 -- --> v1:172.21.15.202:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70280bcae0 con 0x7f7028152770 2023-03-06T13:49:25.696 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.692+0000 7f702e26f700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f702806d920 con 0x7f702806a330 2023-03-06T13:49:25.697 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.692+0000 7f702e26f700 1 -- --> v2:172.21.15.202:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70280bcd30 con 0x7f702806e950 2023-03-06T13:49:25.697 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.692+0000 7f7027fff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f702806a330 0x7f70280bd8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:25.697 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.692+0000 7f7027fff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f702806a330 0x7f70280bd8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:39222/0 (socket says 172.21.15.86:39222) 2023-03-06T13:49:25.697 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.692+0000 7f7027fff700 1 -- 172.21.15.86:0/1512893258 learned_addr learned my addr 172.21.15.86:0/1512893258 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-03-06T13:49:25.697 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.692+0000 7f7027fff700 1 -- 172.21.15.86:0/1512893258 >> v2:172.21.15.202:3300/0 conn(0x7f702806e950 msgr2=0x7f702806a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T13:49:25.697 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.692+0000 7f7027fff700 1 --2- 172.21.15.86:0/1512893258 >> v2:172.21.15.202:3300/0 conn(0x7f702806e950 0x7f702806a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:25.697 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.692+0000 7f7027fff700 1 -- 172.21.15.86:0/1512893258 >> v1:172.21.15.202:6789/0 conn(0x7f7028152770 legacy=0x7f7028152bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T13:49:25.698 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.692+0000 7f7027fff700 1 -- 172.21.15.86:0/1512893258 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f702814fd20 con 0x7f702806a330 2023-03-06T13:49:25.698 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.692+0000 7f7027fff700 1 --2- 172.21.15.86:0/1512893258 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f702806a330 0x7f70280bd8a0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f702806ed20 tx=0x7f701c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17bc58833dbd3a83 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T13:49:25.698 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.692+0000 7f7026ffd700 1 -- 172.21.15.86:0/1512893258 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f701c004230 con 0x7f702806a330 2023-03-06T13:49:25.698 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.692+0000 7f7026ffd700 1 -- 172.21.15.86:0/1512893258 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f701c004390 con 0x7f702806a330 2023-03-06T13:49:25.698 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.692+0000 7f7026ffd700 1 -- 172.21.15.86:0/1512893258 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f701c0036a0 con 0x7f702806a330 2023-03-06T13:49:25.698 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.693+0000 7f702e26f700 1 -- 172.21.15.86:0/1512893258 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f702806a330 msgr2=0x7f70280bd8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:25.698 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.693+0000 7f702e26f700 1 --2- 172.21.15.86:0/1512893258 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f702806a330 0x7f70280bd8a0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f702806ed20 tx=0x7f701c009bd0 comp rx=0 tx=0).stop 2023-03-06T13:49:25.699 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.693+0000 7f702e26f700 1 -- 172.21.15.86:0/1512893258 shutdown_connections 2023-03-06T13:49:25.699 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.693+0000 7f702e26f700 1 --2- 172.21.15.86:0/1512893258 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f702806a330 0x7f70280bd8a0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:25.699 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.693+0000 7f702e26f700 1 --2- 172.21.15.86:0/1512893258 >> v2:172.21.15.202:3300/0 conn(0x7f702806e950 0x7f702806a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:25.699 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.693+0000 7f702e26f700 1 -- 172.21.15.86:0/1512893258 >> 172.21.15.86:0/1512893258 conn(0x7f702806b440 msgr2=0x7f702806b840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T13:49:25.699 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.693+0000 7f702e26f700 1 -- 172.21.15.86:0/1512893258 shutdown_connections 2023-03-06T13:49:25.699 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.693+0000 7f702e26f700 1 -- 172.21.15.86:0/1512893258 wait complete. 2023-03-06T13:49:25.702 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.694+0000 7f702e26f700 1 Processor -- start 2023-03-06T13:49:25.702 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.695+0000 7f702e26f700 1 -- start start 2023-03-06T13:49:25.702 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.695+0000 7f702e26f700 1 --2- >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f702806a330 0x7f70281e84c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:25.702 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.695+0000 7f702e26f700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f702806e950 0x7f70281d9c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:25.702 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.695+0000 7f702e26f700 1 --2- >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f7028152770 0x7f70281432f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:25.703 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.695+0000 7f702e26f700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70281e9230 con 0x7f702806e950 2023-03-06T13:49:25.703 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.695+0000 7f702e26f700 1 -- --> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f702814bf30 con 0x7f702806a330 2023-03-06T13:49:25.703 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.695+0000 7f702e26f700 1 -- --> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70281e8a00 con 0x7f7028152770 2023-03-06T13:49:25.703 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.696+0000 7f70277fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f702806e950 0x7f70281d9c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:25.703 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.696+0000 7f70277fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f702806e950 0x7f70281d9c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:39230/0 (socket says 172.21.15.86:39230) 2023-03-06T13:49:25.703 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.696+0000 7f70277fe700 1 -- 172.21.15.86:0/218464184 learned_addr learned my addr 172.21.15.86:0/218464184 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-03-06T13:49:25.703 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.696+0000 7f7027fff700 1 --2- 172.21.15.86:0/218464184 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f702806a330 0x7f70281e84c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:25.704 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.696+0000 7f702c80c700 1 --2- 172.21.15.86:0/218464184 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f7028152770 0x7f70281432f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:25.704 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.696+0000 7f70277fe700 1 -- 172.21.15.86:0/218464184 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f7028152770 msgr2=0x7f70281432f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:25.704 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.696+0000 7f70277fe700 1 --2- 172.21.15.86:0/218464184 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f7028152770 0x7f70281432f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:25.704 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.696+0000 7f70277fe700 1 -- 172.21.15.86:0/218464184 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f702806a330 msgr2=0x7f70281e84c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:25.704 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.696+0000 7f70277fe700 1 --2- 172.21.15.86:0/218464184 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f702806a330 0x7f70281e84c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:25.704 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.696+0000 7f70277fe700 1 -- 172.21.15.86:0/218464184 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f701c009550 con 0x7f702806e950 2023-03-06T13:49:25.704 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.696+0000 7f7027fff700 1 --2- 172.21.15.86:0/218464184 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f702806a330 0x7f70281e84c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-06T13:49:25.705 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.696+0000 7f702c80c700 1 --2- 172.21.15.86:0/218464184 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f7028152770 0x7f70281432f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-06T13:49:25.705 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.696+0000 7f70277fe700 1 --2- 172.21.15.86:0/218464184 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f702806e950 0x7f70281d9c20 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f701800b530 tx=0x7f701800b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T13:49:25.705 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.696+0000 7f7024ff9700 1 -- 172.21.15.86:0/218464184 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7018011830 con 0x7f702806e950 2023-03-06T13:49:25.705 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.696+0000 7f7024ff9700 1 -- 172.21.15.86:0/218464184 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7018011990 con 0x7f702806e950 2023-03-06T13:49:25.705 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.696+0000 7f702e26f700 1 -- 172.21.15.86:0/218464184 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70280bdde0 con 0x7f702806e950 2023-03-06T13:49:25.705 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.696+0000 7f7024ff9700 1 -- 172.21.15.86:0/218464184 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7018011d40 con 0x7f702806e950 2023-03-06T13:49:25.705 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.696+0000 7f702e26f700 1 -- 172.21.15.86:0/218464184 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7028150000 con 0x7f702806e950 2023-03-06T13:49:25.706 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.698+0000 7f7024ff9700 1 -- 172.21.15.86:0/218464184 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f7018021070 con 0x7f702806e950 2023-03-06T13:49:25.706 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.698+0000 7f7024ff9700 1 --2- 172.21.15.86:0/218464184 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7f70140682f0 0x7f701406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:25.706 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.698+0000 7f7027fff700 1 --2- 172.21.15.86:0/218464184 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7f70140682f0 0x7f701406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:25.706 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.698+0000 7f7024ff9700 1 -- 172.21.15.86:0/218464184 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7018085b50 con 0x7f702806e950 2023-03-06T13:49:25.706 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.698+0000 7f7027fff700 1 --2- 172.21.15.86:0/218464184 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7f70140682f0 0x7f701406a7a0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f701c009c10 tx=0x7f701c008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T13:49:25.711 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.700+0000 7f703a3f8b80 1 Processor -- start 2023-03-06T13:49:25.712 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.700+0000 7f703a3f8b80 1 -- start start 2023-03-06T13:49:25.712 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.700+0000 7f703a3f8b80 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561a63ea4ad0 0x561a63ea4ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:25.712 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.700+0000 7f703a3f8b80 1 --2- >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x561a63eaa410 0x561a63ea8030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:25.712 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.700+0000 7f703a3f8b80 1 --2- >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x561a63ea8570 0x561a63ec4900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:25.712 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.700+0000 7f703a3f8b80 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x561a63d93bc0 con 0x561a63ea4ad0 2023-03-06T13:49:25.712 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.700+0000 7f703a3f8b80 1 -- --> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] -- mon_getmap magic: 0 v1 -- 0x561a63e02350 con 0x561a63ea8570 2023-03-06T13:49:25.713 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.700+0000 7f703a3f8b80 1 -- --> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] -- mon_getmap magic: 0 v1 -- 0x561a63dfb880 con 0x561a63eaa410 2023-03-06T13:49:25.713 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.701+0000 7f7027fff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561a63ea4ad0 0x561a63ea4ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:25.713 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.701+0000 7f7027fff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561a63ea4ad0 0x561a63ea4ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:39236/0 (socket says 172.21.15.86:39236) 2023-03-06T13:49:25.713 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.701+0000 7f7027fff700 1 -- 172.21.15.86:0/3606392506 learned_addr learned my addr 172.21.15.86:0/3606392506 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-03-06T13:49:25.713 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.701+0000 7f70277fe700 1 --2- 172.21.15.86:0/3606392506 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x561a63eaa410 0x561a63ea8030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:25.713 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.701+0000 7f702c80c700 1 --2- 172.21.15.86:0/3606392506 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x561a63ea8570 0x561a63ec4900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:25.714 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.701+0000 7f7027fff700 1 -- 172.21.15.86:0/3606392506 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x561a63eaa410 msgr2=0x561a63ea8030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T13:49:25.714 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.701+0000 7f7027fff700 1 --2- 172.21.15.86:0/3606392506 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x561a63eaa410 0x561a63ea8030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:25.714 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.701+0000 7f7027fff700 1 -- 172.21.15.86:0/3606392506 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x561a63ea8570 msgr2=0x561a63ec4900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T13:49:25.714 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.701+0000 7f7027fff700 1 --2- 172.21.15.86:0/3606392506 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x561a63ea8570 0x561a63ec4900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:25.714 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.701+0000 7f7027fff700 1 -- 172.21.15.86:0/3606392506 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561a63c7d5e0 con 0x561a63ea4ad0 2023-03-06T13:49:25.714 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.701+0000 7f7027fff700 1 --2- 172.21.15.86:0/3606392506 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561a63ea4ad0 0x561a63ea4ea0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f701c009fd0 tx=0x7f701c010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=422d7b3f673827b0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T13:49:25.714 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.701+0000 7f700dffb700 1 -- 172.21.15.86:0/3606392506 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f701c003cb0 con 0x561a63ea4ad0 2023-03-06T13:49:25.715 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.701+0000 7f700dffb700 1 -- 172.21.15.86:0/3606392506 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f701c020070 con 0x561a63ea4ad0 2023-03-06T13:49:25.715 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.701+0000 7f700dffb700 1 -- 172.21.15.86:0/3606392506 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f701c012840 con 0x561a63ea4ad0 2023-03-06T13:49:25.715 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.702+0000 7f703a3f8b80 1 -- 172.21.15.86:0/3606392506 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561a63ea4ad0 msgr2=0x561a63ea4ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:25.715 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.702+0000 7f703a3f8b80 1 --2- 172.21.15.86:0/3606392506 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561a63ea4ad0 0x561a63ea4ea0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f701c009fd0 tx=0x7f701c010000 comp rx=0 tx=0).stop 2023-03-06T13:49:25.716 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.702+0000 7f703a3f8b80 1 -- 172.21.15.86:0/3606392506 shutdown_connections 2023-03-06T13:49:25.716 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.702+0000 7f703a3f8b80 1 --2- 172.21.15.86:0/3606392506 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561a63ea4ad0 0x561a63ea4ea0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:25.716 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.702+0000 7f703a3f8b80 1 --2- 172.21.15.86:0/3606392506 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x561a63ea8570 0x561a63ec4900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:25.716 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.702+0000 7f703a3f8b80 1 --2- 172.21.15.86:0/3606392506 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x561a63eaa410 0x561a63ea8030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:25.716 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.702+0000 7f703a3f8b80 1 -- 172.21.15.86:0/3606392506 >> 172.21.15.86:0/3606392506 conn(0x561a63e9e720 msgr2=0x561a63ea75b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T13:49:25.716 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.702+0000 7f703a3f8b80 1 -- 172.21.15.86:0/3606392506 shutdown_connections 2023-03-06T13:49:25.716 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.702+0000 7f703a3f8b80 1 -- 172.21.15.86:0/3606392506 wait complete. 2023-03-06T13:49:25.717 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.702+0000 7f703a3f8b80 1 -- start start 2023-03-06T13:49:25.717 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.703+0000 7f703a3f8b80 1 Processor -- start 2023-03-06T13:49:25.717 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.703+0000 7f703a3f8b80 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561a63ea4ad0 0x561a63ef3c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:25.717 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.703+0000 7f703a3f8b80 1 --2- >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x561a63ea8570 0x561a63ee1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:25.717 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.703+0000 7f703a3f8b80 1 --2- >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x561a63eaa410 0x561a63ee1880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:25.717 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.703+0000 7f703a3f8b80 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x561a63c7f8d0 con 0x561a63ea4ad0 2023-03-06T13:49:25.717 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.703+0000 7f703a3f8b80 1 -- --> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] -- mon_getmap magic: 0 v1 -- 0x561a63ede590 con 0x561a63ea8570 2023-03-06T13:49:25.718 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.703+0000 7f703a3f8b80 1 -- --> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] -- mon_getmap magic: 0 v1 -- 0x561a63ef4820 con 0x561a63eaa410 2023-03-06T13:49:25.718 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.703+0000 7f703a3f8b80 10 client.0 _ll_register_callbacks cb 0x561a63d99630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-06T13:49:25.718 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.703+0000 7f7027fff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561a63ea4ad0 0x561a63ef3c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:25.718 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.703+0000 7f7027fff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561a63ea4ad0 0x561a63ef3c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:39242/0 (socket says 172.21.15.86:39242) 2023-03-06T13:49:25.718 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.703+0000 7f7027fff700 1 -- 172.21.15.86:0/1984814713 learned_addr learned my addr 172.21.15.86:0/1984814713 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-03-06T13:49:25.718 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.703+0000 7f70277fe700 1 --2- 172.21.15.86:0/1984814713 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x561a63ea8570 0x561a63ee1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:25.718 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.703+0000 7f702c80c700 1 --2- 172.21.15.86:0/1984814713 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x561a63eaa410 0x561a63ee1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:25.719 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.704+0000 7f7027fff700 1 -- 172.21.15.86:0/1984814713 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x561a63eaa410 msgr2=0x561a63ee1880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T13:49:25.719 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.704+0000 7f7027fff700 1 --2- 172.21.15.86:0/1984814713 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x561a63eaa410 0x561a63ee1880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:25.719 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.704+0000 7f7027fff700 1 -- 172.21.15.86:0/1984814713 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x561a63ea8570 msgr2=0x561a63ee1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T13:49:25.719 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.704+0000 7f7027fff700 1 --2- 172.21.15.86:0/1984814713 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x561a63ea8570 0x561a63ee1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:25.719 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.704+0000 7f7027fff700 1 -- 172.21.15.86:0/1984814713 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f702814fd20 con 0x561a63ea4ad0 2023-03-06T13:49:25.719 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.704+0000 7f7027fff700 1 --2- 172.21.15.86:0/1984814713 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561a63ea4ad0 0x561a63ef3c40 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f701c004720 tx=0x7f701c0047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9d8d75baee62703 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T13:49:25.719 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.704+0000 7f7006ffd700 10 client.0 ms_handle_connect on v2:172.21.15.86:3300/0 2023-03-06T13:49:25.720 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.704+0000 7f7006ffd700 1 -- 172.21.15.86:0/1984814713 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f701c012a50 con 0x561a63ea4ad0 2023-03-06T13:49:25.720 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.704+0000 7f7006ffd700 1 -- 172.21.15.86:0/1984814713 <== mon.0 v2:172.21.15.86:3300/0 2 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f701c022070 con 0x561a63ea4ad0 2023-03-06T13:49:25.720 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.704+0000 7f703a3f8b80 1 -- 172.21.15.86:0/1984814713 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561a63dc9140 con 0x561a63ea4ad0 2023-03-06T13:49:25.720 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.704+0000 7f7006ffd700 1 -- 172.21.15.86:0/1984814713 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7f701c012bb0 con 0x561a63ea4ad0 2023-03-06T13:49:25.720 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.704+0000 7f703a3f8b80 10 client.4587 fetch_fsmap learned FSMap version 8 2023-03-06T13:49:25.720 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.704+0000 7f703a3f8b80 1 -- 172.21.15.86:0/1984814713 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x561a63c29d90 con 0x561a63ea4ad0 2023-03-06T13:49:25.720 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.704+0000 7f7006ffd700 1 -- 172.21.15.86:0/1984814713 <== mon.0 v2:172.21.15.86:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x561a63dc9140 con 0x561a63ea4ad0 2023-03-06T13:49:25.721 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.704+0000 7f7006ffd700 1 -- 172.21.15.86:0/1984814713 <== mon.0 v2:172.21.15.86:3300/0 5 ==== fsmap(e 8) v1 ==== 3106+0+0 (secure 0 0 0) 0x7f701c012d10 con 0x561a63ea4ad0 2023-03-06T13:49:25.721 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.704+0000 7f703a3f8b80 10 client.4587 fetch_fsmap finished waiting for FSMap version 8 2023-03-06T13:49:25.721 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.704+0000 7f703a3f8b80 10 client.4587 resolve_mds: resolved name 'b' to daemon mds.b 2023-03-06T13:49:25.721 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.704+0000 7f703a3f8b80 20 client.4587 populate_metadata read hostname 'smithi086' 2023-03-06T13:49:25.721 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.704+0000 7f703a3f8b80 1 --2- 172.21.15.86:0/1984814713 >> [v2:172.21.15.202:6832/142821572,v1:172.21.15.202:6834/142821572] conn(0x561a63ef0250 0x561a63ef0620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:25.722 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.704+0000 7f703a3f8b80 4 client.4587 mds_command: new command op to 4300 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-06T13:49:25.722 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.704+0000 7f703a3f8b80 1 -- 172.21.15.86:0/1984814713 --> [v2:172.21.15.202:6832/142821572,v1:172.21.15.202:6834/142821572] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561a63c7ff10 con 0x561a63ef0250 2023-03-06T13:49:25.722 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.704+0000 7f70277fe700 1 --2- 172.21.15.86:0/1984814713 >> [v2:172.21.15.202:6832/142821572,v1:172.21.15.202:6834/142821572] conn(0x561a63ef0250 0x561a63ef0620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:25.722 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.705+0000 7f7006ffd700 10 client.4587 ms_handle_connect on v2:172.21.15.202:6832/142821572 2023-03-06T13:49:25.722 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.705+0000 7f70277fe700 1 --2- 172.21.15.86:0/1984814713 >> [v2:172.21.15.202:6832/142821572,v1:172.21.15.202:6834/142821572] conn(0x561a63ef0250 0x561a63ef0620 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=601f243538894129 server_cookie=d4cab5153d45c37a in_seq=0 out_seq=0 2023-03-06T13:49:25.723 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.706+0000 7f7006ffd700 1 -- 172.21.15.86:0/1984814713 <== mds.0 v2:172.21.15.202:6832/142821572 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x561a63c7ff10 con 0x561a63ef0250 2023-03-06T13:49:25.723 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.706+0000 7f7006ffd700 10 client.4587 handle_command_reply: tid=0 2023-03-06T13:49:25.723 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.706+0000 7f703a3f8b80 1 client.4587 shutdown 2023-03-06T13:49:25.723 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.706+0000 7f703a3f8b80 1 -- 172.21.15.86:0/1984814713 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561a63ea4ad0 msgr2=0x561a63ef3c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:25.723 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.706+0000 7f703a3f8b80 1 --2- 172.21.15.86:0/1984814713 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561a63ea4ad0 0x561a63ef3c40 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f701c004720 tx=0x7f701c0047c0 comp rx=0 tx=0).stop 2023-03-06T13:49:25.723 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.706+0000 7f703a3f8b80 1 -- 172.21.15.86:0/1984814713 shutdown_connections 2023-03-06T13:49:25.723 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.706+0000 7f703a3f8b80 1 --2- 172.21.15.86:0/1984814713 >> [v2:172.21.15.202:6832/142821572,v1:172.21.15.202:6834/142821572] conn(0x561a63ef0250 0x561a63ef0620 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:25.724 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.706+0000 7f703a3f8b80 1 --2- 172.21.15.86:0/1984814713 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561a63ea4ad0 0x561a63ef3c40 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:25.724 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.706+0000 7f703a3f8b80 1 --2- 172.21.15.86:0/1984814713 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x561a63eaa410 0x561a63ee1880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:25.724 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.706+0000 7f7006ffd700 0 client.4587 ms_handle_reset on v2:172.21.15.202:6832/142821572 2023-03-06T13:49:25.724 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.706+0000 7f703a3f8b80 1 --2- 172.21.15.86:0/1984814713 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x561a63ea8570 0x561a63ee1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:25.724 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.706+0000 7f703a3f8b80 1 -- 172.21.15.86:0/1984814713 >> 172.21.15.86:0/1984814713 conn(0x561a63e9e720 msgr2=0x561a63ea4ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T13:49:25.724 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.706+0000 7f703a3f8b80 1 -- 172.21.15.86:0/1984814713 shutdown_connections 2023-03-06T13:49:25.724 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.706+0000 7f703a3f8b80 1 -- 172.21.15.86:0/1984814713 wait complete. 2023-03-06T13:49:25.725 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.706+0000 7f703a3f8b80 20 client.4587 trim_cache size 0 max 16384 2023-03-06T13:49:25.731 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.724+0000 7f703a3f8b80 1 Processor -- start 2023-03-06T13:49:25.732 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.724+0000 7f703a3f8b80 1 -- start start 2023-03-06T13:49:25.732 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.724+0000 7f703a3f8b80 1 --2- >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x561a63ea4ad0 0x561a63ea3a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:25.733 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.724+0000 7f703a3f8b80 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561a63ea8570 0x561a63ef3c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:25.733 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.724+0000 7f703a3f8b80 1 --2- >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x561a63eaa410 0x561a63edef10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:25.733 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.724+0000 7f703a3f8b80 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x561a63eaa030 con 0x561a63ea8570 2023-03-06T13:49:25.733 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.724+0000 7f703a3f8b80 1 -- --> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] -- mon_getmap magic: 0 v1 -- 0x561a63ed8d80 con 0x561a63eaa410 2023-03-06T13:49:25.733 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.724+0000 7f703a3f8b80 1 -- --> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] -- mon_getmap magic: 0 v1 -- 0x561a63eaaeb0 con 0x561a63ea4ad0 2023-03-06T13:49:25.734 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.724+0000 7f70277fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561a63ea8570 0x561a63ef3c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:25.734 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.724+0000 7f70277fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561a63ea8570 0x561a63ef3c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:39252/0 (socket says 172.21.15.86:39252) 2023-03-06T13:49:25.734 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.724+0000 7f70277fe700 1 -- 172.21.15.86:0/815458758 learned_addr learned my addr 172.21.15.86:0/815458758 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-03-06T13:49:25.734 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.724+0000 7f7027fff700 1 --2- 172.21.15.86:0/815458758 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x561a63ea4ad0 0x561a63ea3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:25.734 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.724+0000 7f702c80c700 1 --2- 172.21.15.86:0/815458758 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x561a63eaa410 0x561a63edef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:25.735 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.725+0000 7f70277fe700 1 -- 172.21.15.86:0/815458758 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x561a63ea4ad0 msgr2=0x561a63ea3a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T13:49:25.735 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.725+0000 7f70277fe700 1 --2- 172.21.15.86:0/815458758 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x561a63ea4ad0 0x561a63ea3a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:25.735 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.725+0000 7f70277fe700 1 -- 172.21.15.86:0/815458758 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x561a63eaa410 msgr2=0x561a63edef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T13:49:25.735 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.725+0000 7f70277fe700 1 --2- 172.21.15.86:0/815458758 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x561a63eaa410 0x561a63edef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:25.735 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.725+0000 7f70277fe700 1 -- 172.21.15.86:0/815458758 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561a63dc2140 con 0x561a63ea8570 2023-03-06T13:49:25.735 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.725+0000 7f7027fff700 1 --2- 172.21.15.86:0/815458758 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x561a63ea4ad0 0x561a63ea3a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-06T13:49:25.735 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.725+0000 7f70277fe700 1 --2- 172.21.15.86:0/815458758 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561a63ea8570 0x561a63ef3c40 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f7018052520 tx=0x7f7018055e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd84840257dee3ef server_cookie=0 in_seq=0 out_seq=0 2023-03-06T13:49:25.736 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.725+0000 7f700e7fc700 1 -- 172.21.15.86:0/815458758 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f701805de70 con 0x561a63ea8570 2023-03-06T13:49:25.736 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.725+0000 7f700e7fc700 1 -- 172.21.15.86:0/815458758 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70180544d0 con 0x561a63ea8570 2023-03-06T13:49:25.736 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.725+0000 7f700e7fc700 1 -- 172.21.15.86:0/815458758 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f701806d2c0 con 0x561a63ea8570 2023-03-06T13:49:25.736 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.725+0000 7f703a3f8b80 1 -- 172.21.15.86:0/815458758 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561a63ea8570 msgr2=0x561a63ef3c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:25.736 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.725+0000 7f703a3f8b80 1 --2- 172.21.15.86:0/815458758 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561a63ea8570 0x561a63ef3c40 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f7018052520 tx=0x7f7018055e60 comp rx=0 tx=0).stop 2023-03-06T13:49:25.736 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.725+0000 7f703a3f8b80 1 -- 172.21.15.86:0/815458758 shutdown_connections 2023-03-06T13:49:25.736 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.725+0000 7f703a3f8b80 1 --2- 172.21.15.86:0/815458758 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x561a63eaa410 0x561a63edef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:25.736 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.725+0000 7f703a3f8b80 1 --2- 172.21.15.86:0/815458758 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x561a63ea4ad0 0x561a63ea3a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:25.737 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.725+0000 7f703a3f8b80 1 --2- 172.21.15.86:0/815458758 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561a63ea8570 0x561a63ef3c40 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:25.737 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.725+0000 7f703a3f8b80 1 -- 172.21.15.86:0/815458758 >> 172.21.15.86:0/815458758 conn(0x561a63e9e720 msgr2=0x561a63ea5b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T13:49:25.737 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.725+0000 7f703a3f8b80 1 -- 172.21.15.86:0/815458758 shutdown_connections 2023-03-06T13:49:25.737 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.725+0000 7f703a3f8b80 1 -- 172.21.15.86:0/815458758 wait complete. 2023-03-06T13:49:25.737 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.726+0000 7f703a3f8b80 1 -- start start 2023-03-06T13:49:25.738 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.726+0000 7f703a3f8b80 1 Processor -- start 2023-03-06T13:49:25.738 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.727+0000 7f703a3f8b80 1 --2- >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x561a63ea4ad0 0x561a63ef4040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:25.738 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.727+0000 7f703a3f8b80 1 --2- >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x561a63ea8570 0x561a63ee90f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:25.738 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.727+0000 7f703a3f8b80 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561a63eaa410 0x561a63ee75f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:25.738 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.727+0000 7f703a3f8b80 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x561a63ee7d40 con 0x561a63eaa410 2023-03-06T13:49:25.739 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.727+0000 7f703a3f8b80 1 -- --> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] -- mon_getmap magic: 0 v1 -- 0x561a63edcf60 con 0x561a63ea4ad0 2023-03-06T13:49:25.739 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.727+0000 7f703a3f8b80 1 -- --> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] -- mon_getmap magic: 0 v1 -- 0x561a63f032d0 con 0x561a63ea8570 2023-03-06T13:49:25.739 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.727+0000 7f703a3f8b80 10 client.0 _ll_register_callbacks cb 0x561a63d99630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-06T13:49:25.739 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.727+0000 7f702c80c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561a63eaa410 0x561a63ee75f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:25.740 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.727+0000 7f702c80c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561a63eaa410 0x561a63ee75f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:39260/0 (socket says 172.21.15.86:39260) 2023-03-06T13:49:25.740 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.727+0000 7f702c80c700 1 -- 172.21.15.86:0/2761909589 learned_addr learned my addr 172.21.15.86:0/2761909589 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-03-06T13:49:25.740 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.727+0000 7f70277fe700 1 --2- 172.21.15.86:0/2761909589 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x561a63ea8570 0x561a63ee90f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:25.741 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.727+0000 7f7027fff700 1 --2- 172.21.15.86:0/2761909589 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x561a63ea4ad0 0x561a63ef4040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:25.741 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.727+0000 7f702c80c700 1 -- 172.21.15.86:0/2761909589 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x561a63ea8570 msgr2=0x561a63ee90f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T13:49:25.741 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.727+0000 7f702c80c700 1 --2- 172.21.15.86:0/2761909589 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x561a63ea8570 0x561a63ee90f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:25.741 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.727+0000 7f702c80c700 1 -- 172.21.15.86:0/2761909589 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x561a63ea4ad0 msgr2=0x561a63ef4040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T13:49:25.742 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.727+0000 7f702c80c700 1 --2- 172.21.15.86:0/2761909589 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x561a63ea4ad0 0x561a63ef4040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:25.742 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.727+0000 7f702c80c700 1 -- 172.21.15.86:0/2761909589 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7028150000 con 0x561a63eaa410 2023-03-06T13:49:25.742 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.727+0000 7f702c80c700 1 --2- 172.21.15.86:0/2761909589 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561a63eaa410 0x561a63ee75f0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f70280a7590 tx=0x7f7020011eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc19338144a6f611 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T13:49:25.742 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.727+0000 7f7006ffd700 10 client.0 ms_handle_connect on v2:172.21.15.86:3300/0 2023-03-06T13:49:25.743 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.727+0000 7f7006ffd700 1 -- 172.21.15.86:0/2761909589 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7020016070 con 0x561a63eaa410 2023-03-06T13:49:25.743 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.727+0000 7f7006ffd700 1 -- 172.21.15.86:0/2761909589 <== mon.0 v2:172.21.15.86:3300/0 2 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f702000fa70 con 0x561a63eaa410 2023-03-06T13:49:25.743 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.727+0000 7f703a3f8b80 1 -- 172.21.15.86:0/2761909589 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561a63db9160 con 0x561a63eaa410 2023-03-06T13:49:25.743 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.728+0000 7f7006ffd700 1 -- 172.21.15.86:0/2761909589 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7f702000fc30 con 0x561a63eaa410 2023-03-06T13:49:25.743 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.728+0000 7f703a3f8b80 10 client.4593 fetch_fsmap learned FSMap version 8 2023-03-06T13:49:25.743 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.728+0000 7f703a3f8b80 1 -- 172.21.15.86:0/2761909589 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x561a63c50200 con 0x561a63eaa410 2023-03-06T13:49:25.743 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.728+0000 7f7006ffd700 1 -- 172.21.15.86:0/2761909589 <== mon.0 v2:172.21.15.86:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x561a63db9160 con 0x561a63eaa410 2023-03-06T13:49:25.744 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.728+0000 7f7006ffd700 1 -- 172.21.15.86:0/2761909589 <== mon.0 v2:172.21.15.86:3300/0 5 ==== fsmap(e 8) v1 ==== 3106+0+0 (secure 0 0 0) 0x7f702000c050 con 0x561a63eaa410 2023-03-06T13:49:25.744 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.728+0000 7f703a3f8b80 10 client.4593 fetch_fsmap finished waiting for FSMap version 8 2023-03-06T13:49:25.744 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.728+0000 7f703a3f8b80 10 client.4593 resolve_mds: resolved name 'b' to daemon mds.b 2023-03-06T13:49:25.744 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.728+0000 7f703a3f8b80 20 client.4593 populate_metadata read hostname 'smithi086' 2023-03-06T13:49:25.745 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.728+0000 7f703a3f8b80 1 --2- 172.21.15.86:0/2761909589 >> [v2:172.21.15.202:6832/142821572,v1:172.21.15.202:6834/142821572] conn(0x561a63ed8380 0x561a63f41bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:25.745 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.728+0000 7f703a3f8b80 4 client.4593 mds_command: new command op to 4300 tid=0[{"prefix": "status"}] 2023-03-06T13:49:25.745 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.728+0000 7f703a3f8b80 1 -- 172.21.15.86:0/2761909589 --> [v2:172.21.15.202:6832/142821572,v1:172.21.15.202:6834/142821572] -- command(tid 0: {"prefix": "status"}) v1 -- 0x561a63da3170 con 0x561a63ed8380 2023-03-06T13:49:25.745 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.728+0000 7f7027fff700 1 --2- 172.21.15.86:0/2761909589 >> [v2:172.21.15.202:6832/142821572,v1:172.21.15.202:6834/142821572] conn(0x561a63ed8380 0x561a63f41bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:25.746 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.728+0000 7f7006ffd700 10 client.4593 ms_handle_connect on v2:172.21.15.202:6832/142821572 2023-03-06T13:49:25.746 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.728+0000 7f7027fff700 1 --2- 172.21.15.86:0/2761909589 >> [v2:172.21.15.202:6832/142821572,v1:172.21.15.202:6834/142821572] conn(0x561a63ed8380 0x561a63f41bb0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5cf1b7f28f03752 server_cookie=d83c326ccf37c8cd in_seq=0 out_seq=0 2023-03-06T13:49:25.746 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.729+0000 7f7006ffd700 1 -- 172.21.15.86:0/2761909589 <== mds.0 v2:172.21.15.202:6832/142821572 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+330 (crc 0 0 0) 0x561a63da3170 con 0x561a63ed8380 2023-03-06T13:49:25.746 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.729+0000 7f7006ffd700 10 client.4593 handle_command_reply: tid=0 2023-03-06T13:49:25.747 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.729+0000 7f703a3f8b80 1 client.4593 shutdown 2023-03-06T13:49:25.747 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.729+0000 7f703a3f8b80 1 -- 172.21.15.86:0/2761909589 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561a63eaa410 msgr2=0x561a63ee75f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:25.747 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.729+0000 7f703a3f8b80 1 --2- 172.21.15.86:0/2761909589 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561a63eaa410 0x561a63ee75f0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f70280a7590 tx=0x7f7020011eb0 comp rx=0 tx=0).stop 2023-03-06T13:49:25.748 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.729+0000 7f703a3f8b80 1 -- 172.21.15.86:0/2761909589 shutdown_connections 2023-03-06T13:49:25.748 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.729+0000 7f703a3f8b80 1 --2- 172.21.15.86:0/2761909589 >> [v2:172.21.15.202:6832/142821572,v1:172.21.15.202:6834/142821572] conn(0x561a63ed8380 0x561a63f41bb0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:25.748 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.729+0000 7f703a3f8b80 1 --2- 172.21.15.86:0/2761909589 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561a63eaa410 0x561a63ee75f0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:25.748 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.729+0000 7f7006ffd700 0 client.4593 ms_handle_reset on v2:172.21.15.202:6832/142821572 2023-03-06T13:49:25.749 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.729+0000 7f703a3f8b80 1 --2- 172.21.15.86:0/2761909589 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x561a63ea4ad0 0x561a63ef4040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:25.749 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.729+0000 7f703a3f8b80 1 --2- 172.21.15.86:0/2761909589 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x561a63ea8570 0x561a63ee90f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:25.749 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.729+0000 7f703a3f8b80 1 -- 172.21.15.86:0/2761909589 >> 172.21.15.86:0/2761909589 conn(0x561a63e9e720 msgr2=0x561a63ea4ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T13:49:25.750 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.729+0000 7f703a3f8b80 1 -- 172.21.15.86:0/2761909589 shutdown_connections 2023-03-06T13:49:25.750 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.729+0000 7f703a3f8b80 1 -- 172.21.15.86:0/2761909589 wait complete. 2023-03-06T13:49:25.750 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.729+0000 7f703a3f8b80 20 client.4593 trim_cache size 0 max 16384 2023-03-06T13:49:25.751 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2023-03-06T13:49:25.751 INFO:teuthology.orchestra.run.smithi086.stdout: "cluster_fsid": "2cca6c77-50cb-47d8-a8c7-444575d01327", 2023-03-06T13:49:25.752 INFO:teuthology.orchestra.run.smithi086.stdout: "whoami": 0, 2023-03-06T13:49:25.752 INFO:teuthology.orchestra.run.smithi086.stdout: "id": 4300, 2023-03-06T13:49:25.752 INFO:teuthology.orchestra.run.smithi086.stdout: "want_state": "up:active", 2023-03-06T13:49:25.752 INFO:teuthology.orchestra.run.smithi086.stdout: "state": "up:active", 2023-03-06T13:49:25.753 INFO:teuthology.orchestra.run.smithi086.stdout: "fs_name": "cephfs", 2023-03-06T13:49:25.753 INFO:teuthology.orchestra.run.smithi086.stdout: "rank_uptime": 12.020997120000001, 2023-03-06T13:49:25.753 INFO:teuthology.orchestra.run.smithi086.stdout: "mdsmap_epoch": 8, 2023-03-06T13:49:25.753 INFO:teuthology.orchestra.run.smithi086.stdout: "osdmap_epoch": 23, 2023-03-06T13:49:25.754 INFO:teuthology.orchestra.run.smithi086.stdout: "osdmap_epoch_barrier": 23, 2023-03-06T13:49:25.754 INFO:teuthology.orchestra.run.smithi086.stdout: "uptime": 17.316014281000001 2023-03-06T13:49:25.754 INFO:teuthology.orchestra.run.smithi086.stdout:} 2023-03-06T13:49:25.756 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.729+0000 7f702e26f700 1 -- 172.21.15.86:0/218464184 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7f70140682f0 msgr2=0x7f701406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:25.756 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.729+0000 7f702e26f700 1 --2- 172.21.15.86:0/218464184 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7f70140682f0 0x7f701406a7a0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f701c009c10 tx=0x7f701c008030 comp rx=0 tx=0).stop 2023-03-06T13:49:25.756 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.729+0000 7f702e26f700 1 -- 172.21.15.86:0/218464184 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f702806e950 msgr2=0x7f70281d9c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:25.756 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.729+0000 7f702e26f700 1 --2- 172.21.15.86:0/218464184 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f702806e950 0x7f70281d9c20 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f701800b530 tx=0x7f701800b8f0 comp rx=0 tx=0).stop 2023-03-06T13:49:25.756 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.729+0000 7f702e26f700 1 -- 172.21.15.86:0/218464184 shutdown_connections 2023-03-06T13:49:25.756 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.729+0000 7f702e26f700 1 --2- 172.21.15.86:0/218464184 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7f70140682f0 0x7f701406a7a0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:25.757 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.729+0000 7f702e26f700 1 --2- 172.21.15.86:0/218464184 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7f7028152770 0x7f70281432f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:25.757 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.729+0000 7f702e26f700 1 --2- 172.21.15.86:0/218464184 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7f702806a330 0x7f70281e84c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:25.757 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.729+0000 7f702e26f700 1 --2- 172.21.15.86:0/218464184 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f702806e950 0x7f70281d9c20 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:25.757 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.729+0000 7f702e26f700 1 -- 172.21.15.86:0/218464184 >> 172.21.15.86:0/218464184 conn(0x7f702806b440 msgr2=0x7f70280718b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T13:49:25.757 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.730+0000 7f702e26f700 1 -- 172.21.15.86:0/218464184 shutdown_connections 2023-03-06T13:49:25.757 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:25.730+0000 7f702e26f700 1 -- 172.21.15.86:0/218464184 wait complete. 2023-03-06T13:49:25.758 INFO:teuthology.run_tasks:Running task kclient... 2023-03-06T13:49:25.782 INFO:tasks.kclient:Mounting kernel clients... 2023-03-06T13:49:25.783 INFO:tasks.kclient:config is {'client.0': {}} 2023-03-06T13:49:25.783 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-06T13:49:25.784 DEBUG:teuthology.orchestra.run.smithi086:> ip netns list 2023-03-06T13:49:25.801 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-06T13:49:25.802 DEBUG:teuthology.orchestra.run.smithi086:> sudo ip link delete ceph-brx 2023-03-06T13:49:25.869 INFO:teuthology.orchestra.run.smithi086.stderr:Cannot find device "ceph-brx" 2023-03-06T13:49:25.870 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-03-06T13:49:25.871 INFO:tasks.kclient:client.0 config is {'syntax': 'v2'} 2023-03-06T13:49:25.871 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-03-06T13:49:25.872 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-03-06T13:49:25.872 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-03-06T13:49:26.030 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:26.028+0000 7faa6c6d3700 1 Processor -- start 2023-03-06T13:49:26.031 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:26.028+0000 7faa6c6d3700 1 -- start start 2023-03-06T13:49:26.033 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:26.029+0000 7faa6c6d3700 1 --2- >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7faa64149420 0x7faa640c2860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:26.033 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:26.029+0000 7faa6c6d3700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa64153340 con 0x7faa640c2da0 2023-03-06T13:49:26.034 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:26.029+0000 7faa6c6d3700 1 -- --> v1:172.21.15.202:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa641497f0 con 0x7faa6406ea90 2023-03-06T13:49:26.034 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:26.029+0000 7faa6c6d3700 1 -- --> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa64152750 con 0x7faa64149420 2023-03-06T13:49:26.034 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:26.029+0000 7faa69c6e700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7faa640c2da0 0x7faa6414f0c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:49412/0 (socket says 172.21.15.86:49412) 2023-03-06T13:49:26.034 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:26.029+0000 7faa69c6e700 1 -- 172.21.15.86:0/1772335312 learned_addr learned my addr 172.21.15.86:0/1772335312 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-03-06T13:49:26.034 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:26.030+0000 7faa6a46f700 1 --2- 172.21.15.86:0/1772335312 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7faa64149420 0x7faa640c2860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:26.034 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:26.030+0000 7faa6946d700 1 -- 172.21.15.86:0/1772335312 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2410555854 0 0) 0x7faa64153340 con 0x7faa640c2da0 2023-03-06T13:49:26.034 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:26.030+0000 7faa6946d700 1 -- 172.21.15.86:0/1772335312 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faa500035b0 con 0x7faa640c2da0 2023-03-06T13:49:26.035 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:26.030+0000 7faa6946d700 1 -- 172.21.15.86:0/1772335312 <== mon.0 v1:172.21.15.86:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 110964548 0 0) 0x7faa500035b0 con 0x7faa640c2da0 2023-03-06T13:49:26.035 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:26.030+0000 7faa6946d700 1 -- 172.21.15.86:0/1772335312 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7faa64149420 msgr2=0x7faa640c2860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T13:49:26.035 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:26.030+0000 7faa6946d700 1 --2- 172.21.15.86:0/1772335312 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7faa64149420 0x7faa640c2860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:26.035 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:26.030+0000 7faa6946d700 1 -- 172.21.15.86:0/1772335312 >> v1:172.21.15.202:6789/0 conn(0x7faa6406ea90 legacy=0x7faa64159a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:26.035 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:26.030+0000 7faa6946d700 1 -- 172.21.15.86:0/1772335312 --> v1:172.21.15.86:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa64152a10 con 0x7faa640c2da0 2023-03-06T13:49:26.035 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:26.030+0000 7faa6946d700 1 -- 172.21.15.86:0/1772335312 <== mon.0 v1:172.21.15.86:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2191261126 0 0) 0x7faa60001670 con 0x7faa640c2da0 2023-03-06T13:49:26.035 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:26.030+0000 7faa6946d700 1 -- 172.21.15.86:0/1772335312 >> v1:172.21.15.86:6789/0 conn(0x7faa640c2da0 legacy=0x7faa6414f0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:26.035 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:26.030+0000 7faa6946d700 1 --2- 172.21.15.86:0/1772335312 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7faa50003aa0 0x7faa50003eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:26.036 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:26.030+0000 7faa6946d700 1 --2- 172.21.15.86:0/1772335312 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faa50004850 0x7faa50004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:26.036 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:26.030+0000 7faa6946d700 1 --2- 172.21.15.86:0/1772335312 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7faa64149420 0x7faa50005290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:26.036 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:26.030+0000 7faa6946d700 1 -- 172.21.15.86:0/1772335312 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa64152750 con 0x7faa50004850 2023-03-06T13:49:26.036 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:26.030+0000 7faa6946d700 1 -- 172.21.15.86:0/1772335312 --> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa5000bba0 con 0x7faa50003aa0 2023-03-06T13:49:26.036 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:26.030+0000 7faa6946d700 1 -- 172.21.15.86:0/1772335312 --> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa5000bd60 con 0x7faa64149420 2023-03-06T13:49:26.036 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:26.030+0000 7faa69c6e700 1 --2- 172.21.15.86:0/1772335312 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faa50004850 0x7faa50004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:26.036 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:26.030+0000 7faa6a46f700 1 --2- 172.21.15.86:0/1772335312 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7faa50003aa0 0x7faa50003eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:26.037 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:26.030+0000 7faa6ac70700 1 --2- 172.21.15.86:0/1772335312 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7faa64149420 0x7faa50005290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:26.037 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:26.030+0000 7faa69c6e700 1 -- 172.21.15.86:0/1772335312 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7faa64149420 msgr2=0x7faa50005290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T13:49:26.037 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:26.030+0000 7faa69c6e700 1 --2- 172.21.15.86:0/1772335312 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7faa64149420 0x7faa50005290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:26.037 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:26.030+0000 7faa69c6e700 1 -- 172.21.15.86:0/1772335312 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7faa50003aa0 msgr2=0x7faa50003eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-06T13:49:26.037 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:26.030+0000 7faa69c6e700 1 --2- 172.21.15.86:0/1772335312 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7faa50003aa0 0x7faa50003eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:26.037 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:26.030+0000 7faa69c6e700 1 -- 172.21.15.86:0/1772335312 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa500035b0 con 0x7faa50004850 2023-03-06T13:49:26.037 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:26.030+0000 7faa69c6e700 1 --2- 172.21.15.86:0/1772335312 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faa50004850 0x7faa50004cc0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7faa6000c210 tx=0x7faa50005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4240e7405d44f80 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T13:49:26.037 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:26.031+0000 7faa6946d700 1 -- 172.21.15.86:0/1772335312 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa60007c10 con 0x7faa50004850 2023-03-06T13:49:26.038 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:26.031+0000 7faa6946d700 1 -- 172.21.15.86:0/1772335312 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa6000cdb0 con 0x7faa50004850 2023-03-06T13:49:26.038 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:26.031+0000 7faa6946d700 1 -- 172.21.15.86:0/1772335312 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa60005ba0 con 0x7faa50004850 2023-03-06T13:49:26.038 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:26.031+0000 7faa6c6d3700 1 -- 172.21.15.86:0/1772335312 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faa50004850 msgr2=0x7faa50004cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:26.038 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:26.031+0000 7faa6c6d3700 1 --2- 172.21.15.86:0/1772335312 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faa50004850 0x7faa50004cc0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7faa6000c210 tx=0x7faa50005880 comp rx=0 tx=0).stop 2023-03-06T13:49:26.038 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:26.031+0000 7faa6ac70700 1 -- 172.21.15.86:0/1772335312 reap_dead start 2023-03-06T13:49:26.038 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:26.031+0000 7faa6c6d3700 1 -- 172.21.15.86:0/1772335312 shutdown_connections 2023-03-06T13:49:26.038 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:26.031+0000 7faa6c6d3700 1 -- 172.21.15.86:0/1772335312 >> 172.21.15.86:0/1772335312 conn(0x7faa6406c0d0 msgr2=0x7faa640c2150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T13:49:26.039 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:26.031+0000 7faa6c6d3700 1 -- 172.21.15.86:0/1772335312 shutdown_connections 2023-03-06T13:49:26.039 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:26.031+0000 7faa6c6d3700 1 -- 172.21.15.86:0/1772335312 wait complete. 2023-03-06T13:49:26.041 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:26.032+0000 7faa6c6d3700 1 Processor -- start 2023-03-06T13:49:26.041 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:26.032+0000 7faa6c6d3700 1 -- start start 2023-03-06T13:49:26.041 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:26.033+0000 7faa6c6d3700 1 --2- >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7faa50004850 0x7faa640c0a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:26.041 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:26.033+0000 7faa6c6d3700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faa640c1a50 0x7faa64146860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:26.041 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:26.033+0000 7faa6c6d3700 1 --2- >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7faa6406a330 0x7faa6406a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:26.041 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:26.033+0000 7faa6c6d3700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa6414c9a0 con 0x7faa640c1a50 2023-03-06T13:49:26.042 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:26.033+0000 7faa6c6d3700 1 -- --> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa64146da0 con 0x7faa6406a330 2023-03-06T13:49:26.042 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:26.033+0000 7faa6c6d3700 1 -- --> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa6414a6c0 con 0x7faa50004850 2023-03-06T13:49:26.042 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:26.033+0000 7faa69c6e700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faa640c1a50 0x7faa64146860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:26.042 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:26.033+0000 7faa69c6e700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faa640c1a50 0x7faa64146860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:39276/0 (socket says 172.21.15.86:39276) 2023-03-06T13:49:26.042 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:26.033+0000 7faa69c6e700 1 -- 172.21.15.86:0/2469039686 learned_addr learned my addr 172.21.15.86:0/2469039686 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-03-06T13:49:26.042 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:26.033+0000 7faa6a46f700 1 --2- 172.21.15.86:0/2469039686 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7faa50004850 0x7faa640c0a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:26.042 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:26.033+0000 7faa6ac70700 1 --2- 172.21.15.86:0/2469039686 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7faa6406a330 0x7faa6406a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:26.042 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:26.033+0000 7faa69c6e700 1 -- 172.21.15.86:0/2469039686 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7faa50004850 msgr2=0x7faa640c0a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:26.043 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:26.033+0000 7faa69c6e700 1 --2- 172.21.15.86:0/2469039686 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7faa50004850 0x7faa640c0a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:26.043 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:26.033+0000 7faa69c6e700 1 -- 172.21.15.86:0/2469039686 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7faa6406a330 msgr2=0x7faa6406a7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:26.043 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:26.033+0000 7faa69c6e700 1 --2- 172.21.15.86:0/2469039686 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7faa6406a330 0x7faa6406a7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:26.043 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:26.033+0000 7faa69c6e700 1 -- 172.21.15.86:0/2469039686 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa64152fd0 con 0x7faa640c1a50 2023-03-06T13:49:26.043 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:26.033+0000 7faa6ac70700 1 --2- 172.21.15.86:0/2469039686 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7faa6406a330 0x7faa6406a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-06T13:49:26.043 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:26.033+0000 7faa69c6e700 1 --2- 172.21.15.86:0/2469039686 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faa640c1a50 0x7faa64146860 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7faa50005810 tx=0x7faa60001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T13:49:26.043 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:26.034+0000 7faa5affd700 1 -- 172.21.15.86:0/2469039686 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa60005ea0 con 0x7faa640c1a50 2023-03-06T13:49:26.044 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:26.034+0000 7faa5affd700 1 -- 172.21.15.86:0/2469039686 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa60001640 con 0x7faa640c1a50 2023-03-06T13:49:26.044 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:26.034+0000 7faa5affd700 1 -- 172.21.15.86:0/2469039686 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa600072d0 con 0x7faa640c1a50 2023-03-06T13:49:26.044 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:26.034+0000 7faa6c6d3700 1 -- 172.21.15.86:0/2469039686 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa64152cf0 con 0x7faa640c1a50 2023-03-06T13:49:26.044 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:26.034+0000 7faa6c6d3700 1 -- 172.21.15.86:0/2469039686 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa6406e610 con 0x7faa640c1a50 2023-03-06T13:49:26.044 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:26.034+0000 7faa6c6d3700 1 -- 172.21.15.86:0/2469039686 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa6404e750 con 0x7faa640c1a50 2023-03-06T13:49:26.044 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:26.035+0000 7faa5affd700 1 -- 172.21.15.86:0/2469039686 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7faa60010070 con 0x7faa640c1a50 2023-03-06T13:49:26.044 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:26.035+0000 7faa5affd700 1 --2- 172.21.15.86:0/2469039686 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7faa480682f0 0x7faa4806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-06T13:49:26.044 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:26.035+0000 7faa5affd700 1 -- 172.21.15.86:0/2469039686 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7faa60086c00 con 0x7faa640c1a50 2023-03-06T13:49:26.045 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:26.035+0000 7faa6a46f700 1 --2- 172.21.15.86:0/2469039686 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7faa480682f0 0x7faa4806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-06T13:49:26.045 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:26.036+0000 7faa6a46f700 1 --2- 172.21.15.86:0/2469039686 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7faa480682f0 0x7faa4806a7a0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7faa54009c60 tx=0x7faa54009210 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-06T13:49:26.045 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:26.039+0000 7faa5affd700 1 -- 172.21.15.86:0/2469039686 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7faa6008c020 con 0x7faa640c1a50 2023-03-06T13:49:26.267 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:26.265+0000 7faa6c6d3700 1 -- 172.21.15.86:0/2469039686 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7faa640c1670 con 0x7faa640c1a50 2023-03-06T13:49:26.268 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:26.266+0000 7faa5affd700 1 -- 172.21.15.86:0/2469039686 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7faa6002b070 con 0x7faa640c1a50 2023-03-06T13:49:26.268 INFO:teuthology.orchestra.run.smithi086.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-03-06T13:49:26.269 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:26.267+0000 7faa6c6d3700 1 -- 172.21.15.86:0/2469039686 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7faa480682f0 msgr2=0x7faa4806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:26.270 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:26.267+0000 7faa6c6d3700 1 --2- 172.21.15.86:0/2469039686 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7faa480682f0 0x7faa4806a7a0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7faa54009c60 tx=0x7faa54009210 comp rx=0 tx=0).stop 2023-03-06T13:49:26.270 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:26.267+0000 7faa6c6d3700 1 -- 172.21.15.86:0/2469039686 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faa640c1a50 msgr2=0x7faa64146860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-06T13:49:26.270 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:26.267+0000 7faa6c6d3700 1 --2- 172.21.15.86:0/2469039686 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faa640c1a50 0x7faa64146860 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7faa50005810 tx=0x7faa60001a00 comp rx=0 tx=0).stop 2023-03-06T13:49:26.270 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:26.268+0000 7faa6c6d3700 1 -- 172.21.15.86:0/2469039686 shutdown_connections 2023-03-06T13:49:26.270 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:26.268+0000 7faa6c6d3700 1 --2- 172.21.15.86:0/2469039686 >> [v2:172.21.15.86:6832/96468,v1:172.21.15.86:6833/96468] conn(0x7faa480682f0 0x7faa4806a7a0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:26.270 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:26.268+0000 7faa6c6d3700 1 --2- 172.21.15.86:0/2469039686 >> [v2:172.21.15.202:3300/0,v1:172.21.15.202:6789/0] conn(0x7faa6406a330 0x7faa6406a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:26.271 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:26.268+0000 7faa6c6d3700 1 --2- 172.21.15.86:0/2469039686 >> [v2:172.21.15.202:3301/0,v1:172.21.15.202:6790/0] conn(0x7faa50004850 0x7faa640c0a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:26.271 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:26.268+0000 7faa6c6d3700 1 --2- 172.21.15.86:0/2469039686 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faa640c1a50 0x7faa64146860 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-06T13:49:26.271 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:26.268+0000 7faa6c6d3700 1 -- 172.21.15.86:0/2469039686 >> 172.21.15.86:0/2469039686 conn(0x7faa6406c0d0 msgr2=0x7faa640bef60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-06T13:49:26.271 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:26.268+0000 7faa6c6d3700 1 -- 172.21.15.86:0/2469039686 shutdown_connections 2023-03-06T13:49:26.271 INFO:teuthology.orchestra.run.smithi086.stderr:2023-03-06T13:49:26.268+0000 7faa6c6d3700 1 -- 172.21.15.86:0/2469039686 wait complete. 2023-03-06T13:49:26.282 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-03-06T13:49:26.282 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-03-06T13:49:26.283 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi086.front.sepia.ceph.com 2023-03-06T13:49:26.283 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-03-06T13:49:26.283 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-03-06T13:49:26.283 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-03-06T13:49:26.283 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-03-06T13:49:26.284 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-03-06T13:49:26.284 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-03-06T13:49:26.284 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-06T13:49:26.284 DEBUG:teuthology.orchestra.run.smithi086:> ip addr 2023-03-06T13:49:26.301 INFO:teuthology.orchestra.run.smithi086.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-03-06T13:49:26.301 INFO:teuthology.orchestra.run.smithi086.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-03-06T13:49:26.301 INFO:teuthology.orchestra.run.smithi086.stdout: inet 127.0.0.1/8 scope host lo 2023-03-06T13:49:26.302 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2023-03-06T13:49:26.302 INFO:teuthology.orchestra.run.smithi086.stdout: inet6 ::1/128 scope host 2023-03-06T13:49:26.302 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2023-03-06T13:49:26.302 INFO:teuthology.orchestra.run.smithi086.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-03-06T13:49:26.302 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 0c:c4:7a:d8:da:f6 brd ff:ff:ff:ff:ff:ff 2023-03-06T13:49:26.302 INFO:teuthology.orchestra.run.smithi086.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-03-06T13:49:26.302 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 0c:c4:7a:d8:da:f7 brd ff:ff:ff:ff:ff:ff 2023-03-06T13:49:26.303 INFO:teuthology.orchestra.run.smithi086.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-03-06T13:49:26.303 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 0c:c4:7a:8f:d8:08 brd ff:ff:ff:ff:ff:ff 2023-03-06T13:49:26.303 INFO:teuthology.orchestra.run.smithi086.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-03-06T13:49:26.303 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 0c:c4:7a:8f:d8:09 brd ff:ff:ff:ff:ff:ff 2023-03-06T13:49:26.303 INFO:teuthology.orchestra.run.smithi086.stdout: inet 172.21.15.86/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-03-06T13:49:26.303 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft 42512sec preferred_lft 42512sec 2023-03-06T13:49:26.303 INFO:teuthology.orchestra.run.smithi086.stdout: inet6 fe80::79bc:e1af:7993:dcac/64 scope link noprefixroute 2023-03-06T13:49:26.304 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2023-03-06T13:49:26.304 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-03-06T13:49:26.304 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-06T13:49:26.305 DEBUG:teuthology.orchestra.run.smithi086:> (cd / && exec bash -c ' 2023-03-06T13:49:26.305 DEBUG:teuthology.orchestra.run.smithi086:> set -e 2023-03-06T13:49:26.305 DEBUG:teuthology.orchestra.run.smithi086:> sudo ip link add name ceph-brx type bridge 2023-03-06T13:49:26.306 DEBUG:teuthology.orchestra.run.smithi086:> sudo ip addr flush dev ceph-brx 2023-03-06T13:49:26.306 DEBUG:teuthology.orchestra.run.smithi086:> sudo ip link set ceph-brx up 2023-03-06T13:49:26.306 DEBUG:teuthology.orchestra.run.smithi086:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-03-06T13:49:26.306 DEBUG:teuthology.orchestra.run.smithi086:> ') 2023-03-06T13:49:26.485 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-06T13:49:26.485 DEBUG:teuthology.orchestra.run.smithi086:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-03-06T13:49:26.513 INFO:teuthology.orchestra.run.smithi086.stdout:1 2023-03-06T13:49:26.515 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-06T13:49:26.515 DEBUG:teuthology.orchestra.run.smithi086:> route 2023-03-06T13:49:26.579 INFO:teuthology.orchestra.run.smithi086.stdout:Kernel IP routing table 2023-03-06T13:49:26.579 INFO:teuthology.orchestra.run.smithi086.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-03-06T13:49:26.579 INFO:teuthology.orchestra.run.smithi086.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-03-06T13:49:26.580 INFO:teuthology.orchestra.run.smithi086.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-03-06T13:49:26.580 INFO:teuthology.orchestra.run.smithi086.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-03-06T13:49:26.580 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-06T13:49:26.581 DEBUG:teuthology.orchestra.run.smithi086:> (cd / && exec bash -c ' 2023-03-06T13:49:26.581 DEBUG:teuthology.orchestra.run.smithi086:> set -e 2023-03-06T13:49:26.581 DEBUG:teuthology.orchestra.run.smithi086:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-03-06T13:49:26.582 DEBUG:teuthology.orchestra.run.smithi086:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-03-06T13:49:26.582 DEBUG:teuthology.orchestra.run.smithi086:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-03-06T13:49:26.582 DEBUG:teuthology.orchestra.run.smithi086:> ') 2023-03-06T13:49:26.833 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-06T13:49:26.834 DEBUG:teuthology.orchestra.run.smithi086:> ip netns list 2023-03-06T13:49:26.850 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-06T13:49:26.851 DEBUG:teuthology.orchestra.run.smithi086:> ip netns list-id 2023-03-06T13:49:26.907 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-06T13:49:26.908 DEBUG:teuthology.orchestra.run.smithi086:> (cd / && exec bash -c ' 2023-03-06T13:49:26.908 DEBUG:teuthology.orchestra.run.smithi086:> set -e 2023-03-06T13:49:26.908 DEBUG:teuthology.orchestra.run.smithi086:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-03-06T13:49:26.909 DEBUG:teuthology.orchestra.run.smithi086:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-03-06T13:49:26.909 DEBUG:teuthology.orchestra.run.smithi086:> ') 2023-03-06T13:49:27.001 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-03-06T13:49:27.002 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-06T13:49:27.002 DEBUG:teuthology.orchestra.run.smithi086:> (cd / && exec bash -c ' 2023-03-06T13:49:27.002 DEBUG:teuthology.orchestra.run.smithi086:> set -e 2023-03-06T13:49:27.003 DEBUG:teuthology.orchestra.run.smithi086:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-03-06T13:49:27.003 DEBUG:teuthology.orchestra.run.smithi086:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-03-06T13:49:27.003 DEBUG:teuthology.orchestra.run.smithi086:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-03-06T13:49:27.003 DEBUG:teuthology.orchestra.run.smithi086:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-03-06T13:49:27.004 DEBUG:teuthology.orchestra.run.smithi086:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-03-06T13:49:27.004 DEBUG:teuthology.orchestra.run.smithi086:> ') 2023-03-06T13:49:27.218 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-06T13:49:27.219 DEBUG:teuthology.orchestra.run.smithi086:> (cd / && exec bash -c ' 2023-03-06T13:49:27.219 DEBUG:teuthology.orchestra.run.smithi086:> set -e 2023-03-06T13:49:27.220 DEBUG:teuthology.orchestra.run.smithi086:> sudo ip link set brx.0 up 2023-03-06T13:49:27.220 DEBUG:teuthology.orchestra.run.smithi086:> sudo ip link set dev brx.0 master ceph-brx 2023-03-06T13:49:27.221 DEBUG:teuthology.orchestra.run.smithi086:> ') 2023-03-06T13:49:27.324 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-03-06T13:49:27.324 DEBUG:teuthology.orchestra.run.smithi086:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-03-06T13:49:27.343 INFO:teuthology.orchestra.run.smithi086.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-03-06T13:49:27.344 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-03-06T13:49:27.344 DEBUG:teuthology.orchestra.run.smithi086:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-03-06T13:49:27.400 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-03-06T13:49:27.400 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-06T13:49:27.401 DEBUG:teuthology.orchestra.run.smithi086:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-03-06T13:49:27.493 INFO:teuthology.orchestra.run.smithi086.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-03-06T13:49:27.493 INFO:teuthology.orchestra.run.smithi086.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-03-06T13:49:27.594 INFO:teuthology.orchestra.run.smithi086.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-03-06T13:49:27.595 INFO:teuthology.orchestra.run.smithi086.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-03-06T13:49:27.595 INFO:teuthology.orchestra.run.smithi086.stdout:mount.ceph: resolved to: "172.21.15.86:3300,172.21.15.202:3300,172.21.15.202:3301" 2023-03-06T13:49:27.595 INFO:teuthology.orchestra.run.smithi086.stdout:mount.ceph: trying mount with new device syntax: 0@2cca6c77-50cb-47d8-a8c7-444575d01327.cephfs=/ 2023-03-06T13:49:27.595 INFO:teuthology.orchestra.run.smithi086.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.86:3300/172.21.15.202:3300/172.21.15.202:3301" will pass to kernel 2023-03-06T13:49:27.595 INFO:teuthology.orchestra.run.smithi086.stdout:mount.ceph: v2 mount support check returned 2 2023-03-06T13:49:27.595 INFO:teuthology.orchestra.run.smithi086.stdout:mount.ceph: kernel does not support v2 syntax 2023-03-06T13:49:27.596 INFO:teuthology.orchestra.run.smithi086.stdout:mount.ceph: switching to using v1 address with old syntax 2023-03-06T13:49:27.667 INFO:teuthology.orchestra.run.smithi086.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-03-06T13:49:27.667 INFO:teuthology.orchestra.run.smithi086.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-03-06T13:49:27.668 INFO:teuthology.orchestra.run.smithi086.stdout:mount.ceph: resolved to: "172.21.15.86:3300,172.21.15.202:3300,172.21.15.202:3301" 2023-03-06T13:49:27.668 INFO:teuthology.orchestra.run.smithi086.stdout:mount.ceph: trying mount with new device syntax: 0@2cca6c77-50cb-47d8-a8c7-444575d01327.cephfs=/ 2023-03-06T13:49:27.668 INFO:teuthology.orchestra.run.smithi086.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.86:3300/172.21.15.202:3300/172.21.15.202:3301" will pass to kernel 2023-03-06T13:49:27.668 INFO:teuthology.orchestra.run.smithi086.stdout:mount.ceph: v2 mount support check returned 2 2023-03-06T13:49:27.668 INFO:teuthology.orchestra.run.smithi086.stdout:mount.ceph: kernel does not support v2 syntax 2023-03-06T13:49:27.668 INFO:teuthology.orchestra.run.smithi086.stdout:mount.ceph: switching to using v1 address with old syntax 2023-03-06T13:49:27.668 INFO:teuthology.orchestra.run.smithi086.stdout:mount.ceph: resolved to: "172.21.15.86:6789,172.21.15.202:6789,172.21.15.202:6790" 2023-03-06T13:49:27.669 INFO:teuthology.orchestra.run.smithi086.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.86:6789,172.21.15.202:6789,172.21.15.202:6790:/ 2023-03-06T13:49:27.669 INFO:teuthology.orchestra.run.smithi086.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,key=0,mds_namespace=cephfs,fsid=2cca6c77-50cb-47d8-a8c7-444575d01327" will pass to kernel 2023-03-06T13:49:27.670 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-03-06T13:49:27.670 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-06T13:49:27.670 DEBUG:teuthology.orchestra.run.smithi086:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-03-06T13:49:27.697 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-06T13:49:27.697 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-03-06T13:49:27.783 INFO:teuthology.orchestra.run.smithi086.stdout:client4621 2023-03-06T13:49:27.784 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2023-03-06T13:49:27.784 DEBUG:teuthology.orchestra.run.smithi086:> dd if=/proc/self/mounts of=/dev/stdout 2023-03-06T13:49:27.801 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-06T13:49:27.801 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-03-06T13:49:27.888 INFO:teuthology.orchestra.run.smithi086.stdout:client4621 2023-03-06T13:49:27.888 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-06T13:49:27.889 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-03-06T13:49:27.933 INFO:teuthology.orchestra.run.smithi086.stdout:client4621 2023-03-06T13:49:27.934 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-06T13:49:27.934 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/2cca6c77-50cb-47d8-a8c7-444575d01327.client4621/status') 2023-03-06T13:49:27.988 INFO:teuthology.orchestra.run.smithi086.stdout:instance: client.4621 (3)172.21.15.86:0/816745109 2023-03-06T13:49:27.989 INFO:teuthology.orchestra.run.smithi086.stdout:blocklisted: false 2023-03-06T13:49:27.989 INFO:teuthology.orchestra.run.smithi086.stderr:0+1 records in 2023-03-06T13:49:27.990 INFO:teuthology.orchestra.run.smithi086.stderr:0+1 records out 2023-03-06T13:49:27.990 INFO:teuthology.orchestra.run.smithi086.stderr:69 bytes copied, 2.114e-05 s, 3.3 MB/s 2023-03-06T13:49:27.990 INFO:teuthology.run_tasks:Running task workunit... 2023-03-06T13:49:28.014 INFO:tasks.workunit:Pulling workunits from ref 472aaef4ec3b3a2c29f73ca67854785a910f1f9b 2023-03-06T13:49:28.014 INFO:tasks.workunit:Making a separate scratch dir for every client... 2023-03-06T13:49:28.014 INFO:tasks.workunit:timeout=6h 2023-03-06T13:49:28.015 INFO:tasks.workunit:cleanup=True 2023-03-06T13:49:28.015 DEBUG:teuthology.orchestra.run.smithi086:> stat -- /home/ubuntu/cephtest/mnt.0 2023-03-06T13:49:28.033 INFO:teuthology.orchestra.run.smithi086.stdout: File: /home/ubuntu/cephtest/mnt.0 2023-03-06T13:49:28.033 INFO:teuthology.orchestra.run.smithi086.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2023-03-06T13:49:28.033 INFO:teuthology.orchestra.run.smithi086.stdout:Device: 2eh/46d Inode: 1 Links: 2 2023-03-06T13:49:28.034 INFO:teuthology.orchestra.run.smithi086.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2023-03-06T13:49:28.035 INFO:teuthology.orchestra.run.smithi086.stdout:Context: system_u:object_r:cephfs_t:s0 2023-03-06T13:49:28.035 INFO:teuthology.orchestra.run.smithi086.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2023-03-06T13:49:28.035 INFO:teuthology.orchestra.run.smithi086.stdout:Modify: 2023-03-06 13:49:13.710091046 +0000 2023-03-06T13:49:28.035 INFO:teuthology.orchestra.run.smithi086.stdout:Change: 2023-03-06 13:49:27.693705726 +0000 2023-03-06T13:49:28.036 INFO:teuthology.orchestra.run.smithi086.stdout: Birth: 2023-03-06 13:49:13.710091046 +0000 2023-03-06T13:49:28.036 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2023-03-06T13:49:28.036 DEBUG:teuthology.orchestra.run.smithi086:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2023-03-06T13:49:28.107 DEBUG:teuthology.orchestra.run.smithi086:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 472aaef4ec3b3a2c29f73ca67854785a910f1f9b 2023-03-06T13:49:28.165 INFO:tasks.workunit.client.0.smithi086.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2023-03-06T13:49:42.368 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T13:49:42.371 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T13:50:12.443 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T13:50:12.446 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T13:50:14.011 INFO:tasks.workunit.client.0.smithi086.stderr:Note: switching to '472aaef4ec3b3a2c29f73ca67854785a910f1f9b'. 2023-03-06T13:50:14.011 INFO:tasks.workunit.client.0.smithi086.stderr: 2023-03-06T13:50:14.011 INFO:tasks.workunit.client.0.smithi086.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2023-03-06T13:50:14.012 INFO:tasks.workunit.client.0.smithi086.stderr:changes and commit them, and you can discard any commits you make in this 2023-03-06T13:50:14.012 INFO:tasks.workunit.client.0.smithi086.stderr:state without impacting any branches by switching back to a branch. 2023-03-06T13:50:14.012 INFO:tasks.workunit.client.0.smithi086.stderr: 2023-03-06T13:50:14.012 INFO:tasks.workunit.client.0.smithi086.stderr:If you want to create a new branch to retain commits you create, you may 2023-03-06T13:50:14.012 INFO:tasks.workunit.client.0.smithi086.stderr:do so (now or later) by using -c with the switch command. Example: 2023-03-06T13:50:14.012 INFO:tasks.workunit.client.0.smithi086.stderr: 2023-03-06T13:50:14.012 INFO:tasks.workunit.client.0.smithi086.stderr: git switch -c 2023-03-06T13:50:14.013 INFO:tasks.workunit.client.0.smithi086.stderr: 2023-03-06T13:50:14.013 INFO:tasks.workunit.client.0.smithi086.stderr:Or undo this operation with: 2023-03-06T13:50:14.013 INFO:tasks.workunit.client.0.smithi086.stderr: 2023-03-06T13:50:14.013 INFO:tasks.workunit.client.0.smithi086.stderr: git switch - 2023-03-06T13:50:14.013 INFO:tasks.workunit.client.0.smithi086.stderr: 2023-03-06T13:50:14.013 INFO:tasks.workunit.client.0.smithi086.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2023-03-06T13:50:14.013 INFO:tasks.workunit.client.0.smithi086.stderr: 2023-03-06T13:50:14.013 INFO:tasks.workunit.client.0.smithi086.stderr:HEAD is now at 472aaef4ec3 Merge PR #45224 into wip-vshankar-testing-20230303.023823 2023-03-06T13:50:14.014 DEBUG:teuthology.orchestra.run.smithi086:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2023-03-06T13:50:14.043 INFO:tasks.workunit.client.0.smithi086.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2023-03-06T13:50:14.045 INFO:tasks.workunit.client.0.smithi086.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2023-03-06T13:50:14.045 INFO:tasks.workunit.client.0.smithi086.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2023-03-06T13:50:14.575 INFO:tasks.workunit.client.0.smithi086.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2023-03-06T13:50:14.626 INFO:tasks.workunit.client.0.smithi086.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2023-03-06T13:50:14.663 INFO:tasks.workunit.client.0.smithi086.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2023-03-06T13:50:14.664 INFO:tasks.workunit.client.0.smithi086.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2023-03-06T13:50:14.665 INFO:tasks.workunit.client.0.smithi086.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2023-03-06T13:50:14.700 INFO:tasks.workunit.client.0.smithi086.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2023-03-06T13:50:14.703 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2023-03-06T13:50:14.704 DEBUG:teuthology.orchestra.run.smithi086:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2023-03-06T13:50:14.760 INFO:tasks.workunit:Running workunits matching fs/snaps on client.0... 2023-03-06T13:50:14.762 INFO:tasks.workunit:Running workunit fs/snaps/snap-rm-diff.sh... 2023-03-06T13:50:14.762 DEBUG:teuthology.orchestra.run.smithi086:workunit test fs/snaps/snap-rm-diff.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=472aaef4ec3b3a2c29f73ca67854785a910f1f9b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/snaps/snap-rm-diff.sh 2023-03-06T13:50:14.823 INFO:tasks.workunit.client.0.smithi086.stderr:+ wget -q http://download.ceph.com/qa/linux-2.6.33.tar.bz2 2023-03-06T13:50:17.546 INFO:tasks.workunit.client.0.smithi086.stderr:+ mkdir foo 2023-03-06T13:50:17.550 INFO:tasks.workunit.client.0.smithi086.stderr:+ cp linux-2.6.33.tar.bz2 foo 2023-03-06T13:50:17.592 INFO:tasks.workunit.client.0.smithi086.stderr:+ mkdir foo/.snap/barsnap 2023-03-06T13:50:17.630 INFO:tasks.workunit.client.0.smithi086.stderr:+ rm foo/linux-2.6.33.tar.bz2 2023-03-06T13:50:17.637 INFO:tasks.workunit.client.0.smithi086.stderr:+ diff -q foo/.snap/barsnap/linux-2.6.33.tar.bz2 linux-2.6.33.tar.bz2 2023-03-06T13:50:17.823 INFO:tasks.workunit.client.0.smithi086.stderr:+ echo 'passed: files are identical' 2023-03-06T13:50:17.824 INFO:tasks.workunit.client.0.smithi086.stdout:passed: files are identical 2023-03-06T13:50:17.824 INFO:tasks.workunit.client.0.smithi086.stderr:+ rmdir foo/.snap/barsnap 2023-03-06T13:50:17.840 INFO:tasks.workunit.client.0.smithi086.stdout:OK 2023-03-06T13:50:17.841 INFO:tasks.workunit.client.0.smithi086.stderr:+ echo OK 2023-03-06T13:50:17.841 INFO:teuthology.orchestra.run:Running command with timeout 3600 2023-03-06T13:50:17.842 DEBUG:teuthology.orchestra.run.smithi086:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2023-03-06T13:50:17.909 INFO:tasks.ceph.mds.b.smithi202.stderr:2023-03-06T13:50:17.907+0000 7f623856c700 -1 mds.0.cache.den(0x601 10000000002) newly corrupt dentry to be committed: [dentry #0x100/stray1/10000000002 [4,head] auth NULL (dn xlock x=1 by 0x55a8b0e92c00) (dversion lock w=1 last_client=4621) pv=29 v=28 ap=2 ino=(nil) state=1342177281|new | request=1 lock=2 authpin=1 0x55a8b0e7b180] 2023-03-06T13:50:17.909 INFO:tasks.ceph.mds.b.smithi202.stderr:2023-03-06T13:50:17.907+0000 7f623856c700 -1 mds.0.damage notify_dentry Damage to dentries in fragment * of ino 0x601is fatal because it is a system directory for this rank 2023-03-06T13:50:18.389 INFO:tasks.ceph.mon.a.smithi086.stderr:2023-03-06T13:50:18.387+0000 7fbbadf61700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-03-06T13:50:18.389 INFO:tasks.ceph.mon.a.smithi086.stderr:2023-03-06T13:50:18.387+0000 7fbbadf61700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 mds daemon damaged (MDS_DAMAGE) 2023-03-06T13:50:18.411 INFO:tasks.ceph.mds.b.smithi202.stderr: -27> 2023-03-06T13:50:17.907+0000 7f623856c700 -1 mds.0.cache.den(0x601 10000000002) newly corrupt dentry to be committed: [dentry #0x100/stray1/10000000002 [4,head] auth NULL (dn xlock x=1 by 0x55a8b0e92c00) (dversion lock w=1 last_client=4621) pv=29 v=28 ap=2 ino=(nil) state=1342177281|new | request=1 lock=2 authpin=1 0x55a8b0e7b180] 2023-03-06T13:50:18.411 INFO:tasks.ceph.mds.b.smithi202.stderr: -25> 2023-03-06T13:50:17.907+0000 7f623856c700 -1 mds.0.damage notify_dentry Damage to dentries in fragment * of ino 0x601is fatal because it is a system directory for this rank 2023-03-06T13:50:18.434 INFO:tasks.ceph.mds.b.smithi202.stdout:starting mds.b at 2023-03-06T13:50:42.528 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T13:50:42.531 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T13:51:12.751 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T13:51:12.754 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T13:51:42.857 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T13:51:42.860 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T13:52:12.936 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T13:52:12.938 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T13:52:43.146 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T13:52:43.149 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T13:53:13.212 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T13:53:13.221 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T13:53:43.305 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T13:53:43.309 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T13:54:13.382 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T13:54:13.385 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T13:54:43.453 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T13:54:43.456 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T13:55:13.525 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T13:55:13.528 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T13:55:43.607 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T13:55:43.611 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T13:56:13.731 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T13:56:13.734 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T13:56:43.805 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T13:56:43.808 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T13:57:13.868 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T13:57:13.871 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T13:57:43.989 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T13:57:43.994 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T13:58:14.111 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T13:58:14.114 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T13:58:44.201 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T13:58:44.204 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T13:59:14.261 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T13:59:14.264 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T13:59:44.332 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T13:59:44.335 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:00:00.000 INFO:tasks.ceph.mon.a.smithi086.stderr:2023-03-06T13:59:59.998+0000 7fbbadf61700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline; 1 mds daemon damaged 2023-03-06T14:00:14.413 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:00:14.416 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:00:44.509 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:00:44.512 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:01:14.564 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:01:14.568 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:01:44.645 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:01:44.648 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:02:14.723 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:02:14.726 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:02:44.786 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:02:44.789 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:03:14.858 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:03:14.861 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:03:44.927 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:03:44.930 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:04:15.001 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:04:15.004 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:04:45.064 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:04:45.067 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:05:15.135 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:05:15.138 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:05:45.207 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:05:45.256 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:06:15.320 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:06:15.323 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:06:45.564 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:06:45.568 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:07:15.630 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:07:15.633 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:07:45.701 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:07:45.705 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:08:15.789 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:08:15.794 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:08:45.862 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:08:45.865 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:09:16.158 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:09:16.161 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:09:46.247 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:09:46.250 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:10:00.000 INFO:tasks.ceph.mon.a.smithi086.stderr:2023-03-06T14:09:59.999+0000 7fbbadf61700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline; 1 mds daemon damaged 2023-03-06T14:10:16.341 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:10:16.345 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:10:46.416 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:10:46.421 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:11:16.582 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:11:16.586 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:11:46.662 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:11:46.666 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:12:16.742 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:12:16.746 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:12:46.831 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:12:46.834 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:13:16.906 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:13:16.910 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:13:46.974 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:13:46.977 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:14:17.210 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:14:17.213 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:14:47.275 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:14:47.279 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:15:17.346 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:15:17.349 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:15:47.437 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:15:47.440 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:16:17.525 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:16:17.528 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:16:47.595 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:16:47.599 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:17:17.669 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:17:17.672 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:17:47.796 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:17:47.800 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:18:17.991 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:18:17.994 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:18:48.064 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:18:48.067 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:19:18.144 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:19:18.147 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:19:48.476 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:19:48.479 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:20:00.000 INFO:tasks.ceph.mon.a.smithi086.stderr:2023-03-06T14:19:59.999+0000 7fbbadf61700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline; 1 mds daemon damaged 2023-03-06T14:20:18.570 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:20:18.573 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:20:48.641 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:20:48.644 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:21:18.727 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:21:18.730 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:21:48.874 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:21:48.877 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:22:18.923 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:22:18.926 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:22:48.995 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:22:48.998 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:23:19.083 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:23:19.087 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:23:49.156 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:23:49.158 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:24:19.250 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:24:19.253 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:24:49.339 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:24:49.342 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:25:19.541 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:25:19.544 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:25:49.721 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:25:49.724 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:26:19.795 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:26:19.798 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:26:49.877 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:26:49.879 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:27:19.955 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:27:19.958 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:27:50.045 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:27:50.048 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:28:20.107 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:28:20.110 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:28:50.220 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:28:50.225 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:29:20.615 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:29:20.617 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:29:50.725 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:29:50.728 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:30:00.000 INFO:tasks.ceph.mon.a.smithi086.stderr:2023-03-06T14:29:59.998+0000 7fbbadf61700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline; 1 mds daemon damaged 2023-03-06T14:30:20.801 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:30:20.804 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:30:50.882 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:30:50.885 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:31:20.944 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:31:20.947 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:31:51.033 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:31:51.036 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:32:21.188 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:32:21.191 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:32:51.259 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:32:51.262 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:33:21.319 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:33:21.322 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:33:51.472 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:33:51.475 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:34:21.607 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:34:21.609 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:34:51.736 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:34:51.739 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:35:21.874 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:35:21.877 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:35:52.012 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:35:52.015 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:36:22.078 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:36:22.081 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:36:52.346 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:36:52.349 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:37:22.417 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:37:22.420 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:37:52.555 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:37:52.558 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:38:22.926 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:38:22.929 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:38:53.084 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:38:53.087 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:39:23.164 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:39:23.167 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:39:53.308 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:39:53.311 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:40:00.000 INFO:tasks.ceph.mon.a.smithi086.stderr:2023-03-06T14:39:59.999+0000 7fbbadf61700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline; 1 mds daemon damaged 2023-03-06T14:40:23.462 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:40:23.465 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:40:53.825 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:40:53.834 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:41:23.980 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:41:23.983 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:41:54.060 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:41:54.063 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:42:24.197 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:42:24.200 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:42:54.327 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:42:54.330 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:43:24.499 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:43:24.502 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:43:54.561 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:43:54.564 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:44:24.851 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:44:24.853 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:44:54.915 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:44:54.918 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:45:25.196 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:45:25.199 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:45:55.251 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:45:55.255 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:46:25.336 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:46:25.339 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:46:55.399 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:46:55.402 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:47:25.477 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:47:25.480 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:47:55.544 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:47:55.547 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:48:25.681 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:48:25.684 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:48:55.745 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:48:55.748 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:49:25.817 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:49:25.820 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:49:55.881 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:49:55.884 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:50:00.000 INFO:tasks.ceph.mon.a.smithi086.stderr:2023-03-06T14:49:59.999+0000 7fbbadf61700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline; 1 mds daemon damaged 2023-03-06T14:50:17.889 ERROR:teuthology:Uncaught exception (Hub) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_a2dfb0599b24ec4a1585108a2792a4567ce0a378/virtualenv/lib/python3.8/site-packages/paramiko/channel.py", line 747, in recv_stderr out = self.in_stderr_buffer.read(nbytes, self.timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_a2dfb0599b24ec4a1585108a2792a4567ce0a378/virtualenv/lib/python3.8/site-packages/paramiko/buffered_pipe.py", line 164, in read raise PipeTimeout() paramiko.buffered_pipe.PipeTimeout During handling of the above exception, another exception occurred: Traceback (most recent call last): File "src/gevent/greenlet.py", line 906, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_teuthology_a2dfb0599b24ec4a1585108a2792a4567ce0a378/teuthology/orchestra/run.py", line 323, in copy_file_to copy_to_log(src, logger, capture=stream, quiet=quiet) File "/home/teuthworker/src/git.ceph.com_teuthology_a2dfb0599b24ec4a1585108a2792a4567ce0a378/teuthology/orchestra/run.py", line 276, in copy_to_log for line in f: File "/home/teuthworker/src/git.ceph.com_teuthology_a2dfb0599b24ec4a1585108a2792a4567ce0a378/virtualenv/lib/python3.8/site-packages/paramiko/file.py", line 125, in __next__ line = self.readline() File "/home/teuthworker/src/git.ceph.com_teuthology_a2dfb0599b24ec4a1585108a2792a4567ce0a378/virtualenv/lib/python3.8/site-packages/paramiko/file.py", line 291, in readline new_data = self._read(n) File "/home/teuthworker/src/git.ceph.com_teuthology_a2dfb0599b24ec4a1585108a2792a4567ce0a378/virtualenv/lib/python3.8/site-packages/paramiko/channel.py", line 1376, in _read return self.channel.recv_stderr(size) File "/home/teuthworker/src/git.ceph.com_teuthology_a2dfb0599b24ec4a1585108a2792a4567ce0a378/virtualenv/lib/python3.8/site-packages/paramiko/channel.py", line 749, in recv_stderr raise socket.timeout() socket.timeout 2023-03-06T14:50:17.891 ERROR:teuthology:Uncaught exception (Hub) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_a2dfb0599b24ec4a1585108a2792a4567ce0a378/virtualenv/lib/python3.8/site-packages/paramiko/channel.py", line 699, in recv out = self.in_buffer.read(nbytes, self.timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_a2dfb0599b24ec4a1585108a2792a4567ce0a378/virtualenv/lib/python3.8/site-packages/paramiko/buffered_pipe.py", line 164, in read raise PipeTimeout() paramiko.buffered_pipe.PipeTimeout During handling of the above exception, another exception occurred: Traceback (most recent call last): File "src/gevent/greenlet.py", line 906, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_teuthology_a2dfb0599b24ec4a1585108a2792a4567ce0a378/teuthology/orchestra/run.py", line 323, in copy_file_to copy_to_log(src, logger, capture=stream, quiet=quiet) File "/home/teuthworker/src/git.ceph.com_teuthology_a2dfb0599b24ec4a1585108a2792a4567ce0a378/teuthology/orchestra/run.py", line 276, in copy_to_log for line in f: File "/home/teuthworker/src/git.ceph.com_teuthology_a2dfb0599b24ec4a1585108a2792a4567ce0a378/virtualenv/lib/python3.8/site-packages/paramiko/file.py", line 125, in __next__ line = self.readline() File "/home/teuthworker/src/git.ceph.com_teuthology_a2dfb0599b24ec4a1585108a2792a4567ce0a378/virtualenv/lib/python3.8/site-packages/paramiko/file.py", line 291, in readline new_data = self._read(n) File "/home/teuthworker/src/git.ceph.com_teuthology_a2dfb0599b24ec4a1585108a2792a4567ce0a378/virtualenv/lib/python3.8/site-packages/paramiko/channel.py", line 1361, in _read return self.channel.recv(size) File "/home/teuthworker/src/git.ceph.com_teuthology_a2dfb0599b24ec4a1585108a2792a4567ce0a378/virtualenv/lib/python3.8/site-packages/paramiko/channel.py", line 701, in recv raise socket.timeout() socket.timeout 2023-03-06T14:50:26.130 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:50:26.132 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:50:56.193 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:50:56.196 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:51:26.466 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:51:26.469 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:51:56.531 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:51:56.534 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:52:26.602 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:52:26.605 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:52:56.658 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:52:56.661 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:53:26.740 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:53:26.743 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:53:56.979 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:53:56.982 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:54:27.059 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:54:27.062 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:54:57.124 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:54:57.128 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:55:27.487 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:55:27.490 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:55:57.552 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:55:57.555 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:56:27.616 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:56:27.619 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:56:57.697 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:56:57.700 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:57:27.783 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:57:27.786 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:57:57.851 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:57:57.854 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:58:27.914 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:58:27.917 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:58:57.973 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:58:57.976 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:59:28.043 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:59:28.046 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:59:58.116 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T14:59:58.119 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:00:00.000 INFO:tasks.ceph.mon.a.smithi086.stderr:2023-03-06T14:59:59.999+0000 7fbbadf61700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline; 1 mds daemon damaged 2023-03-06T15:00:28.195 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:00:28.198 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:00:58.259 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:00:58.261 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:01:28.325 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:01:28.329 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:01:58.406 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:01:58.409 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:02:28.469 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:02:28.472 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:02:58.767 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:02:58.770 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:03:28.841 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:03:28.844 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:03:58.904 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:03:58.907 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:04:28.969 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:04:28.972 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:04:59.032 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:04:59.035 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:05:29.110 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:05:29.113 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:05:59.186 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:05:59.189 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:06:29.311 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:06:29.313 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:06:59.505 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:06:59.509 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:07:29.570 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:07:29.573 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:07:59.701 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:07:59.704 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:08:30.030 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:08:30.033 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:09:00.144 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:09:00.147 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:09:30.264 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:09:30.267 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:10:00.001 INFO:tasks.ceph.mon.a.smithi086.stderr:2023-03-06T15:10:00.000+0000 7fbbadf61700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline; 1 mds daemon damaged 2023-03-06T15:10:00.542 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:10:00.546 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:10:30.631 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:10:30.634 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:11:00.761 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:11:00.764 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:11:30.993 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:11:30.996 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:12:01.129 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:12:01.132 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:12:31.267 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:12:31.270 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:13:01.488 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:13:01.491 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:13:31.635 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:13:31.638 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:14:01.773 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:14:01.776 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:14:31.928 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:14:31.932 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:15:02.058 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:15:02.061 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:15:32.221 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:15:32.224 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:16:02.376 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:16:02.379 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:16:32.498 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:16:32.501 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:17:02.611 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:17:02.613 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:17:32.690 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:17:32.693 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:18:02.759 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:18:02.763 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:18:32.826 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:18:32.830 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:19:02.907 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:19:02.910 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:19:32.986 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:19:32.989 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:20:00.000 INFO:tasks.ceph.mon.a.smithi086.stderr:2023-03-06T15:19:59.998+0000 7fbbadf61700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline; 1 mds daemon damaged 2023-03-06T15:20:03.051 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:20:03.054 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:20:33.131 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:20:33.134 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:21:03.226 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:21:03.229 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:21:33.284 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:21:33.287 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:22:03.574 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:22:03.578 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:22:33.646 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:22:33.649 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:23:03.788 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:23:03.791 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:23:33.986 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:23:33.989 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:24:04.065 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:24:04.068 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:24:34.178 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:24:34.181 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:25:04.241 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:25:04.245 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:25:34.315 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:25:34.318 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:26:04.379 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:26:04.382 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:26:34.501 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:26:34.504 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:27:04.620 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:27:04.623 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:27:34.750 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:27:34.753 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:28:04.821 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:28:04.824 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:28:34.891 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:28:34.894 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:29:05.024 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:29:05.027 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:29:35.154 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:29:35.157 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:29:59.999 INFO:tasks.ceph.mon.a.smithi086.stderr:2023-03-06T15:29:59.999+0000 7fbbadf61700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline; 1 mds daemon damaged 2023-03-06T15:30:05.276 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:30:05.279 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:30:35.430 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:30:35.433 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:31:05.799 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:31:05.802 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:31:35.860 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:31:35.862 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:32:05.987 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:32:05.990 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:32:36.134 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:32:36.138 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:33:06.264 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:33:06.267 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:33:36.377 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:33:36.381 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:34:06.508 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:34:06.512 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:34:36.648 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:34:36.651 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:35:06.793 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:35:06.796 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:35:36.956 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:35:36.959 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:36:07.070 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:36:07.073 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:36:37.291 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:36:37.294 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:37:07.430 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:37:07.432 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:37:37.576 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:37:37.579 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:38:07.715 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:38:07.719 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:38:37.846 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:38:37.849 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:39:07.992 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:39:07.995 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:39:38.306 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:39:38.309 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:40:00.000 INFO:tasks.ceph.mon.a.smithi086.stderr:2023-03-06T15:39:59.999+0000 7fbbadf61700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline; 1 mds daemon damaged 2023-03-06T15:40:08.452 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:40:08.455 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:40:38.625 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:40:38.628 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:41:08.799 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:41:08.804 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:41:38.936 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:41:38.939 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:42:09.160 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:42:09.163 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:42:39.295 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:42:39.297 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:43:09.416 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:43:09.419 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:43:39.595 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:43:39.597 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:44:09.719 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:44:09.721 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:44:39.815 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:44:39.819 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:45:09.945 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:45:09.948 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:45:40.108 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:45:40.111 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:46:10.207 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:46:10.210 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:46:40.559 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:46:40.562 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:47:10.690 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:47:10.693 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:47:40.761 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:47:40.765 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:48:10.900 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:48:10.903 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:48:41.030 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:48:41.033 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:49:11.100 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:49:11.103 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:49:41.365 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:49:41.368 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:50:00.000 INFO:tasks.ceph.mon.a.smithi086.stderr:2023-03-06T15:50:00.000+0000 7fbbadf61700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline; 1 mds daemon damaged 2023-03-06T15:50:11.445 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:50:11.448 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:50:41.520 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:50:41.523 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:51:11.584 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:51:11.587 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:51:41.699 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:51:41.702 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:52:11.771 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:52:11.776 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:52:41.843 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:52:41.846 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:53:11.940 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:53:11.943 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:53:41.998 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:53:42.002 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:54:12.287 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:54:12.290 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:54:42.434 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:54:42.437 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:55:12.555 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:55:12.558 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:55:42.703 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:55:42.706 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:56:12.825 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:56:12.828 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:56:42.948 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:56:42.951 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:57:13.020 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:57:13.023 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:57:43.092 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:57:43.095 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:58:13.226 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:58:13.228 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:58:43.371 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:58:43.374 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:59:13.484 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:59:13.487 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:59:43.624 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:59:43.627 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T15:59:59.999 INFO:tasks.ceph.mon.a.smithi086.stderr:2023-03-06T15:59:59.998+0000 7fbbadf61700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline; 1 mds daemon damaged 2023-03-06T16:00:13.754 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:00:13.757 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:00:43.885 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:00:43.888 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:01:14.158 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:01:14.160 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:01:44.238 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:01:44.241 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:02:14.386 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:02:14.388 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:02:44.521 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:02:44.524 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:03:14.643 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:03:14.646 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:03:44.765 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:03:44.768 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:04:14.914 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:04:14.917 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:04:45.025 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:04:45.028 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:05:15.123 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:05:15.126 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:05:45.244 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:05:45.247 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:06:15.393 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:06:15.396 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:06:45.545 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:06:45.548 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:07:15.680 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:07:15.682 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:07:45.827 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:07:45.830 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:08:15.977 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:08:15.980 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:08:46.125 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:08:46.128 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:09:16.279 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:09:16.282 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:09:46.409 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:09:46.412 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:09:59.999 INFO:tasks.ceph.mon.a.smithi086.stderr:2023-03-06T16:09:59.999+0000 7fbbadf61700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline; 1 mds daemon damaged 2023-03-06T16:10:16.531 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:10:16.534 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:10:46.702 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:10:46.705 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:11:16.849 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:11:16.852 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:11:47.004 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:11:47.007 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:12:17.151 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:12:17.154 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:12:47.239 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:12:47.241 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:13:17.358 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:13:17.360 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:13:47.508 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:13:47.511 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:14:17.654 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:14:17.658 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:14:47.793 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:14:47.796 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:15:17.931 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:15:17.934 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:15:48.061 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:15:48.064 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:16:18.216 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:16:18.219 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:16:48.364 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:16:48.367 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:17:18.446 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:17:18.449 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:17:48.592 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:17:48.595 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:18:18.736 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:18:18.739 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:18:48.884 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:18:48.887 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:19:18.952 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:19:18.956 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:19:49.102 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:19:49.105 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:19:59.999 INFO:tasks.ceph.mon.a.smithi086.stderr:2023-03-06T16:20:00.000+0000 7fbbadf61700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline; 1 mds daemon damaged 2023-03-06T16:20:19.239 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:20:19.242 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:20:49.378 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:20:49.382 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:21:19.442 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:21:19.446 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:21:49.565 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:21:49.568 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:22:19.655 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:22:19.658 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:22:49.810 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:22:49.819 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:23:19.935 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:23:19.938 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:23:50.005 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:23:50.008 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:24:20.070 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:24:20.074 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:24:50.217 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:24:50.220 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:25:20.539 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:25:20.542 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:25:50.609 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:25:50.612 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:26:20.735 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:26:20.738 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:26:50.868 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:26:50.872 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:27:20.988 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:27:20.992 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:27:51.126 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:27:51.130 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:28:21.217 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:28:21.221 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:28:51.329 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:28:51.334 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:29:21.487 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:29:21.490 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:29:51.558 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:29:51.561 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:30:00.000 INFO:tasks.ceph.mon.a.smithi086.stderr:2023-03-06T16:29:59.999+0000 7fbbadf61700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline; 1 mds daemon damaged 2023-03-06T16:30:21.629 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:30:21.632 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:30:51.786 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:30:51.790 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:31:21.859 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:31:21.862 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:31:52.006 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:31:52.009 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:32:22.145 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:32:22.148 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:32:52.296 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:32:52.299 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:33:22.452 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:33:22.455 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:33:52.598 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:33:52.601 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:34:22.744 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:34:22.747 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:34:52.800 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:34:52.803 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:35:22.962 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:35:22.965 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:35:53.135 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:35:53.138 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:36:23.289 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:36:23.292 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:36:53.445 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:36:53.448 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:37:23.541 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:37:23.544 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:37:53.666 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:37:53.669 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:38:23.776 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:38:23.779 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:38:53.979 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:38:53.982 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:39:24.117 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:39:24.121 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:39:54.256 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:39:54.259 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:39:59.999 INFO:tasks.ceph.mon.a.smithi086.stderr:2023-03-06T16:39:59.999+0000 7fbbadf61700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline; 1 mds daemon damaged 2023-03-06T16:40:24.412 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:40:24.415 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:40:54.568 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:40:54.571 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:41:24.632 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:41:24.635 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:41:54.738 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:41:54.741 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:42:24.893 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:42:24.897 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:42:55.105 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:42:55.108 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:43:25.223 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:43:25.227 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:43:55.373 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:43:55.376 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:44:25.526 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:44:25.529 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:44:55.666 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:44:55.669 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:45:25.847 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:45:25.850 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:45:55.995 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:45:55.998 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:46:26.142 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:46:26.145 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:46:56.289 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:46:56.292 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:47:26.458 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:47:26.461 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:47:56.584 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:47:56.587 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:48:26.651 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:48:26.655 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:48:56.823 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:48:56.826 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:49:26.970 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:49:26.973 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:49:57.141 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:49:57.144 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:50:00.000 INFO:tasks.ceph.mon.a.smithi086.stderr:2023-03-06T16:49:59.999+0000 7fbbadf61700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline; 1 mds daemon damaged 2023-03-06T16:50:27.295 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:50:27.298 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:50:57.433 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:50:57.436 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:51:27.571 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:51:27.575 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:51:57.734 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:51:57.737 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:52:27.878 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:52:27.881 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:52:58.034 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:52:58.037 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:53:28.173 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:53:28.176 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:53:58.319 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:53:58.322 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:54:28.466 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:54:28.470 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:54:58.605 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:54:58.607 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:55:28.750 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:55:28.753 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:55:58.911 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:55:58.913 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:56:29.160 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:56:29.163 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:56:59.305 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:56:59.308 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:57:29.453 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:57:29.457 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:57:59.600 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:57:59.603 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:58:29.739 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:58:29.741 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:58:59.833 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:58:59.836 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:59:29.980 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T16:59:29.982 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:00:00.000 INFO:tasks.ceph.mon.a.smithi086.stderr:2023-03-06T16:59:59.998+0000 7fbbadf61700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline; 1 mds daemon damaged 2023-03-06T17:00:00.042 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:00:00.045 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:00:30.180 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:00:30.184 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:01:00.528 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:01:00.531 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:01:30.674 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:01:30.678 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:02:00.811 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:02:00.814 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:02:30.879 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:02:30.883 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:03:01.029 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:03:01.032 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:03:31.168 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:03:31.172 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:04:01.297 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:04:01.300 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:04:31.452 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:04:31.456 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:05:01.593 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:05:01.597 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:05:31.862 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:05:31.865 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:06:01.932 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:06:01.935 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:06:32.062 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:06:32.066 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:07:02.125 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:07:02.129 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:07:32.296 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:07:32.300 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:08:02.428 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:08:02.431 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:08:32.551 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:08:32.555 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:09:02.703 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:09:02.706 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:09:32.841 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:09:32.844 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:10:00.000 INFO:tasks.ceph.mon.a.smithi086.stderr:2023-03-06T17:09:59.999+0000 7fbbadf61700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline; 1 mds daemon damaged 2023-03-06T17:10:02.977 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:10:02.979 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:10:33.134 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:10:33.137 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:11:03.372 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:11:03.375 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:11:33.503 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:11:33.506 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:12:03.648 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:12:03.651 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:12:33.777 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:12:33.781 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:13:03.940 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:13:03.943 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:13:34.061 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:13:34.064 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:14:04.201 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:14:04.205 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:14:34.263 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:14:34.266 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:15:04.409 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:15:04.412 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:15:34.564 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:15:34.567 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:16:04.702 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:16:04.705 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:16:34.832 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:16:34.836 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:17:04.986 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:17:04.990 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:17:35.124 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:17:35.128 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:18:05.188 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:18:05.191 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:18:35.311 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:18:35.315 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:19:05.444 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:19:05.446 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:19:35.516 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:19:35.519 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:20:00.000 INFO:tasks.ceph.mon.a.smithi086.stderr:2023-03-06T17:19:59.999+0000 7fbbadf61700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline; 1 mds daemon damaged 2023-03-06T17:20:05.638 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:20:05.641 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:20:35.770 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:20:35.773 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:21:05.924 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:21:05.928 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:21:35.980 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:21:35.983 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:22:06.103 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:22:06.106 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:22:36.226 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:22:36.229 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:23:06.378 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:23:06.381 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:23:36.524 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:23:36.528 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:24:06.668 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:24:06.671 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:24:36.792 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:24:36.795 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:25:06.929 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:25:06.932 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:25:37.076 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:25:37.079 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:26:07.181 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:26:07.184 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:26:37.346 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:26:37.349 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:27:07.494 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:27:07.497 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:27:37.644 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:27:37.647 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:28:07.775 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:28:07.778 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:28:37.904 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:28:37.907 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:29:08.051 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:29:08.054 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:29:38.216 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:29:38.219 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:30:00.000 INFO:tasks.ceph.mon.a.smithi086.stderr:2023-03-06T17:29:59.999+0000 7fbbadf61700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline; 1 mds daemon damaged 2023-03-06T17:30:08.337 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:30:08.341 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:30:38.482 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:30:38.485 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:31:08.690 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:31:08.694 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:31:38.834 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:31:38.837 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:32:09.052 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:32:09.056 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:32:39.184 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:32:39.188 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:33:09.248 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:33:09.251 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:33:39.403 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:33:39.406 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:34:09.515 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:34:09.518 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:34:39.659 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:34:39.664 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:35:09.808 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:35:09.812 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:35:39.987 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:35:39.990 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:36:10.091 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:36:10.094 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:36:40.247 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:36:40.250 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:37:10.310 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:37:10.313 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:37:40.441 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:37:40.445 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:38:10.561 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:38:10.564 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:38:40.716 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:38:40.719 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:39:10.851 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:39:10.854 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:39:40.990 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:39:40.994 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:40:00.000 INFO:tasks.ceph.mon.a.smithi086.stderr:2023-03-06T17:39:59.999+0000 7fbbadf61700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline; 1 mds daemon damaged 2023-03-06T17:40:11.130 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:40:11.133 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:40:41.268 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:40:41.272 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:41:11.374 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:41:11.377 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:41:41.544 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:41:41.547 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:42:11.682 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:42:11.685 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:42:41.833 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:42:41.836 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:43:11.950 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:43:11.953 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:43:42.072 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:43:42.075 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:44:12.193 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:44:12.196 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:44:42.339 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:44:42.342 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:45:12.471 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:45:12.474 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:45:42.623 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:45:42.626 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:46:12.753 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:46:12.760 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:46:42.917 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:46:42.920 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:47:13.064 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:47:13.067 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:47:43.199 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:47:43.202 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:48:13.338 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:48:13.341 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:48:43.486 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:48:43.489 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:49:13.617 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:49:13.620 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:49:43.745 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:49:43.748 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:50:00.001 INFO:tasks.ceph.mon.a.smithi086.stderr:2023-03-06T17:49:59.999+0000 7fbbadf61700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline; 1 mds daemon damaged 2023-03-06T17:50:13.806 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:50:13.809 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:50:43.937 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:50:43.940 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:51:14.115 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:51:14.118 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:51:44.237 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:51:44.240 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:52:14.376 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:52:14.378 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:52:44.506 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:52:44.509 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:53:14.613 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:53:14.616 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:53:44.674 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:53:44.677 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:54:14.800 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:54:14.803 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:54:44.939 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:54:44.942 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:55:14.996 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:55:15.000 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:55:45.116 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:55:45.119 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:56:15.289 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:56:15.293 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:56:45.454 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:56:45.457 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:57:15.582 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:57:15.585 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:57:45.719 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:57:45.722 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:58:15.875 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:58:15.877 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:58:46.013 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:58:46.017 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:59:16.184 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:59:16.187 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:59:46.312 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T17:59:46.315 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:00:00.001 INFO:tasks.ceph.mon.a.smithi086.stderr:2023-03-06T17:59:59.999+0000 7fbbadf61700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline; 1 mds daemon damaged 2023-03-06T18:00:16.435 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:00:16.438 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:00:46.498 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:00:46.501 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:01:16.622 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:01:16.626 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:01:46.766 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:01:46.769 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:02:16.918 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:02:16.921 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:02:46.997 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:02:47.000 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:03:17.128 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:03:17.132 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:03:47.285 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:03:47.288 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:04:17.423 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:04:17.426 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:04:47.554 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:04:47.557 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:05:17.643 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:05:17.646 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:05:47.720 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:05:47.724 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:06:17.896 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:06:17.900 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:06:48.044 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:06:48.047 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:07:18.191 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:07:18.194 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:07:48.314 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:07:48.317 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:08:18.412 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:08:18.415 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:08:48.543 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:08:48.546 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:09:18.696 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:09:18.698 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:09:48.750 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:09:48.753 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:10:00.000 INFO:tasks.ceph.mon.a.smithi086.stderr:2023-03-06T18:09:59.998+0000 7fbbadf61700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline; 1 mds daemon damaged 2023-03-06T18:10:19.006 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:10:19.009 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:10:49.150 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:10:49.153 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:11:19.289 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:11:19.292 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:11:49.424 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:11:49.426 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:12:19.534 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:12:19.537 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:12:49.648 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:12:49.651 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:13:19.938 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:13:19.941 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:13:50.097 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:13:50.100 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:14:20.169 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:14:20.172 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:14:50.306 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:14:50.309 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:15:20.452 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:15:20.456 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:15:50.607 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:15:50.611 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:16:20.770 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:16:20.773 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:16:50.828 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:16:50.831 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:17:20.954 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:17:20.957 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:17:51.100 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:17:51.103 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:18:21.241 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:18:21.244 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:18:51.387 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:18:51.390 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:19:21.526 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:19:21.529 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:19:51.680 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:19:51.683 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:20:00.001 INFO:tasks.ceph.mon.a.smithi086.stderr:2023-03-06T18:19:59.999+0000 7fbbadf61700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline; 1 mds daemon damaged 2023-03-06T18:20:21.829 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:20:21.832 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:20:51.893 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:20:51.896 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:21:22.023 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:21:22.026 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:21:52.191 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:21:52.194 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:22:22.327 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:22:22.330 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:22:52.485 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:22:52.488 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:23:22.838 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:23:22.841 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:23:52.909 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:23:52.911 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:24:23.047 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:24:23.050 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:24:53.189 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:24:53.191 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:25:23.327 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:25:23.330 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:25:53.484 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:25:53.487 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:26:23.633 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:26:23.636 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:26:53.771 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:26:53.774 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:27:23.909 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:27:23.912 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:27:53.963 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:27:53.967 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:28:24.087 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:28:24.090 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:28:54.227 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:28:54.230 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:29:24.366 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:29:24.369 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:29:54.424 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:29:54.427 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:29:59.999 INFO:tasks.ceph.mon.a.smithi086.stderr:2023-03-06T18:29:59.999+0000 7fbbadf61700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline; 1 mds daemon damaged 2023-03-06T18:30:24.563 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:30:24.566 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:30:54.702 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:30:54.705 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:31:24.805 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:31:24.808 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:31:54.945 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:31:54.948 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:32:25.007 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:32:25.010 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:32:55.157 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:32:55.160 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:33:25.299 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:33:25.302 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:33:55.445 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:33:55.448 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:34:25.517 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:34:25.520 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:34:55.650 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:34:55.653 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:35:25.768 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:35:25.771 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:35:55.918 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:35:55.921 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:36:26.261 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:36:26.264 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:36:56.397 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:36:56.400 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:37:26.545 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:37:26.548 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:37:56.709 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:37:56.712 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:38:26.839 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:38:26.842 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:38:56.986 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:38:56.989 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:39:27.098 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:39:27.101 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:39:57.236 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:39:57.239 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:39:59.999 INFO:tasks.ceph.mon.a.smithi086.stderr:2023-03-06T18:39:59.999+0000 7fbbadf61700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline; 1 mds daemon damaged 2023-03-06T18:40:27.381 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:40:27.384 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:40:57.553 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:40:57.557 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:41:27.717 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:41:27.720 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:41:57.839 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:41:57.842 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:42:27.988 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:42:27.990 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:42:58.118 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:42:58.121 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:43:28.250 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:43:28.253 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:43:58.414 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:43:58.417 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:44:28.545 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:44:28.548 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:44:58.675 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:44:58.678 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:45:28.822 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:45:28.825 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:45:58.970 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:45:58.973 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:46:29.131 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:46:29.134 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:46:59.191 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:46:59.194 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:47:29.330 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:47:29.333 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:47:59.469 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:47:59.472 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:48:29.542 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:48:29.545 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:48:59.623 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:48:59.626 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:49:29.729 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:49:29.732 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:50:00.000 INFO:tasks.ceph.mon.a.smithi086.stderr:2023-03-06T18:49:59.999+0000 7fbbadf61700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline; 1 mds daemon damaged 2023-03-06T18:50:00.052 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:50:00.054 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:50:30.124 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:50:30.127 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:51:00.246 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:51:00.249 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:51:30.394 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:51:30.397 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:52:00.533 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:52:00.536 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:52:30.672 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:52:30.675 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:53:00.795 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:53:00.798 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:53:30.859 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:53:30.862 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:54:01.090 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:54:01.093 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:54:31.231 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:54:31.234 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:55:01.299 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:55:01.302 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:55:31.453 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:55:31.457 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:56:01.605 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:56:01.608 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:56:31.770 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:56:31.773 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:57:01.926 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:57:01.929 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:57:32.039 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:57:32.042 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:58:02.196 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:58:02.199 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:58:32.535 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:58:32.538 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:59:02.688 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:59:02.691 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:59:32.817 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T18:59:32.820 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:00:00.000 INFO:tasks.ceph.mon.a.smithi086.stderr:2023-03-06T18:59:59.999+0000 7fbbadf61700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline; 1 mds daemon damaged 2023-03-06T19:00:02.914 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:00:02.917 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:00:33.160 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:00:33.163 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:01:03.263 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:01:03.266 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:01:33.370 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:01:33.373 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:02:03.508 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:02:03.511 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:02:33.672 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:02:33.674 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:03:03.920 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:03:03.923 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:03:34.033 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:03:34.036 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:04:04.169 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:04:04.172 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:04:34.308 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:04:34.311 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:05:04.395 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:05:04.398 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:05:34.531 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:05:34.534 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:06:04.660 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:06:04.663 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:06:34.834 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:06:34.837 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:07:04.989 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:07:04.992 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:07:35.129 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:07:35.131 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:08:05.274 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:08:05.277 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:08:35.416 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:08:35.419 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:09:05.563 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:09:05.566 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:09:35.889 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:09:35.892 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:10:00.000 INFO:tasks.ceph.mon.a.smithi086.stderr:2023-03-06T19:09:59.999+0000 7fbbadf61700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline; 1 mds daemon damaged 2023-03-06T19:10:06.002 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:10:06.006 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:10:36.097 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:10:36.099 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:11:06.235 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:11:06.239 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:11:36.400 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:11:36.403 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:12:06.487 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:12:06.490 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:12:36.641 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:12:36.644 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:13:06.788 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:13:06.791 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:13:36.985 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:13:36.987 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:14:07.153 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:14:07.156 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:14:37.292 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:14:37.295 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:15:07.457 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:15:07.459 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:15:37.653 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:15:37.657 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:16:07.818 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:16:07.821 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:16:37.973 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:16:37.976 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:17:08.128 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:17:08.132 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:17:38.206 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:17:38.210 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:18:08.365 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:18:08.368 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:18:38.438 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:18:38.441 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:19:08.579 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:19:08.582 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:19:38.716 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:19:38.719 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:20:00.000 INFO:tasks.ceph.mon.a.smithi086.stderr:2023-03-06T19:19:59.999+0000 7fbbadf61700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline; 1 mds daemon damaged 2023-03-06T19:20:08.863 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:20:08.865 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:20:38.936 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:20:38.939 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:21:09.084 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:21:09.087 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:21:39.223 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:21:39.226 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:22:09.290 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:22:09.293 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:22:39.425 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:22:39.428 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:23:09.539 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:23:09.542 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:23:39.662 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:23:39.665 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:24:09.802 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:24:09.805 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:24:39.873 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:24:39.876 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:25:09.953 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:25:09.955 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:25:40.018 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:25:40.021 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:26:10.116 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:26:10.119 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:26:40.289 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:26:40.293 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:27:10.355 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:27:10.358 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:27:40.475 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:27:40.478 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:28:10.572 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:28:10.575 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:28:40.636 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:28:40.640 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:29:10.768 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:29:10.771 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:29:41.087 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:29:41.091 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:30:00.000 INFO:tasks.ceph.mon.a.smithi086.stderr:2023-03-06T19:29:59.999+0000 7fbbadf61700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline; 1 mds daemon damaged 2023-03-06T19:30:11.234 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:30:11.237 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:30:41.314 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:30:41.317 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:31:11.477 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:31:11.480 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:31:41.631 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:31:41.634 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:32:11.876 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:32:11.879 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:32:42.008 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:32:42.011 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:33:12.138 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:33:12.141 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:33:42.276 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:33:42.279 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:34:12.422 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:34:12.425 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:34:42.568 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:34:42.571 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:35:12.665 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:35:12.668 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:35:42.808 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:35:42.811 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:36:12.940 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:36:12.943 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:36:43.253 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:36:43.255 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:37:13.384 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:37:13.386 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:37:43.506 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:37:43.508 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:38:13.644 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:38:13.647 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:38:43.807 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:38:43.811 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:39:13.922 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:39:13.925 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:39:44.070 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:39:44.073 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:40:00.000 INFO:tasks.ceph.mon.a.smithi086.stderr:2023-03-06T19:39:59.998+0000 7fbbadf61700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline; 1 mds daemon damaged 2023-03-06T19:40:14.205 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:40:14.208 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:40:44.368 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:40:44.371 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:41:14.521 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:41:14.524 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:41:44.593 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:41:44.596 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:42:14.740 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:42:14.742 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:42:44.879 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:42:44.882 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:43:15.027 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:43:15.030 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:43:45.229 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:43:45.232 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:44:15.384 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:44:15.387 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:44:45.527 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:44:45.530 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:45:15.627 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:45:15.630 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:45:45.773 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:45:45.776 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:46:15.895 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:46:15.898 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:46:45.992 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:46:45.995 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:47:16.114 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:47:16.117 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:47:46.254 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:47:46.257 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:48:16.383 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:48:16.386 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:48:46.456 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:48:46.459 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:49:16.629 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:49:16.632 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:49:46.750 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:49:46.754 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:50:00.000 INFO:tasks.ceph.mon.a.smithi086.stderr:2023-03-06T19:49:59.998+0000 7fbbadf61700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline; 1 mds daemon damaged 2023-03-06T19:50:16.813 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:50:16.817 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:50:46.954 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:50:46.957 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:51:17.010 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:51:17.013 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:51:47.140 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:51:47.143 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:52:17.297 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:52:17.300 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:52:47.452 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:52:47.456 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:53:17.524 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:53:17.527 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:53:47.672 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:53:47.676 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:54:17.762 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:54:17.765 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:54:47.892 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:54:47.895 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:55:18.047 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:55:18.050 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:55:48.212 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:55:48.215 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:56:18.359 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:56:18.362 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:56:48.498 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:56:48.501 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:57:18.653 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:57:18.656 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:57:48.884 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:57:48.887 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:58:18.948 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:58:18.951 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:58:49.037 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:58:49.040 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:59:19.176 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:59:19.179 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:59:49.317 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T19:59:49.320 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:00:00.000 INFO:tasks.ceph.mon.a.smithi086.stderr:2023-03-06T19:59:59.999+0000 7fbbadf61700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline; 1 mds daemon damaged 2023-03-06T20:00:19.437 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:00:19.440 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:00:49.577 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:00:49.580 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:01:19.734 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:01:19.737 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:01:49.880 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:01:49.883 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:02:20.011 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:02:20.015 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:02:50.132 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:02:50.135 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:03:20.238 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:03:20.241 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:03:50.390 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:03:50.393 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:04:20.534 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:04:20.537 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:04:50.674 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:04:50.677 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:05:20.841 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:05:20.844 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:05:50.980 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:05:50.983 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:06:21.349 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:06:21.352 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:06:51.414 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:06:51.416 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:07:21.552 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:07:21.555 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:07:51.724 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:07:51.727 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:08:22.080 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:08:22.083 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:08:52.176 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:08:52.179 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:09:22.308 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:09:22.311 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:09:52.430 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:09:52.433 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:10:00.000 INFO:tasks.ceph.mon.a.smithi086.stderr:2023-03-06T20:09:59.998+0000 7fbbadf61700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline; 1 mds daemon damaged 2023-03-06T20:10:22.568 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:10:22.571 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:10:52.767 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:10:52.770 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:11:22.910 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:11:22.913 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:11:53.073 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:11:53.076 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:12:23.200 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:12:23.203 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:12:53.275 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:12:53.277 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:13:23.580 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:13:23.583 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:13:53.685 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:13:53.688 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:14:23.840 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:14:23.843 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:14:53.979 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:14:53.982 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:15:24.059 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:15:24.062 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:15:54.206 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:15:54.209 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:16:24.330 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:16:24.357 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:16:54.511 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:16:54.514 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:17:24.654 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:17:24.657 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:17:54.809 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:17:54.812 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:18:24.933 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:18:24.936 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:18:54.995 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:18:54.998 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:19:25.082 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:19:25.084 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:19:55.196 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:19:55.199 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:20:00.000 INFO:tasks.ceph.mon.a.smithi086.stderr:2023-03-06T20:19:59.999+0000 7fbbadf61700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline; 1 mds daemon damaged 2023-03-06T20:20:25.335 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:20:25.338 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:20:55.494 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:20:55.497 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:21:25.613 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:21:25.616 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:21:55.694 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:21:55.696 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:22:25.825 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:22:25.828 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:22:55.981 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:22:55.984 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:23:26.053 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:23:26.056 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:23:56.142 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:23:56.144 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:24:26.264 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:24:26.268 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:24:56.325 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:24:56.328 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:25:26.451 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:25:26.454 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:25:56.589 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:25:56.592 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:26:26.729 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:26:26.731 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:26:56.892 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:26:56.895 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:27:27.023 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:27:27.026 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:27:57.145 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:27:57.148 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:28:27.294 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:28:27.297 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:28:57.440 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:28:57.443 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:29:27.513 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:29:27.516 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:29:57.652 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:29:57.655 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:30:00.000 INFO:tasks.ceph.mon.a.smithi086.stderr:2023-03-06T20:29:59.998+0000 7fbbadf61700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline; 1 mds daemon damaged 2023-03-06T20:30:27.782 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:30:27.785 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:30:57.934 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:30:57.937 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:31:28.068 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:31:28.071 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:31:58.231 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:31:58.234 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:32:28.307 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:32:28.310 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:32:58.446 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:32:58.450 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:33:28.590 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:33:28.592 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:33:58.736 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:33:58.738 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:34:28.864 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:34:28.866 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:34:59.013 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:34:59.016 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:35:29.133 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:35:29.136 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:35:59.273 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:35:59.276 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:36:29.352 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:36:29.355 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:36:59.500 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:36:59.503 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:37:29.598 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:37:29.600 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:37:59.752 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:37:59.755 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:38:30.057 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:38:30.060 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:39:00.120 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:39:00.122 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:39:30.201 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:39:30.204 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:40:00.000 INFO:tasks.ceph.mon.a.smithi086.stderr:2023-03-06T20:39:59.999+0000 7fbbadf61700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline; 1 mds daemon damaged 2023-03-06T20:40:00.277 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:40:00.279 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:40:30.341 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:40:30.344 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:41:00.480 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:41:00.483 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:41:30.637 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:41:30.640 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:42:00.792 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:42:00.795 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:42:30.926 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:42:30.929 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:43:01.071 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:43:01.074 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:43:31.135 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:43:31.138 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:44:01.267 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:44:01.269 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:44:31.330 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:44:31.333 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:45:01.453 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:45:01.456 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:45:31.592 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:45:31.595 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:46:01.714 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:46:01.717 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:46:31.837 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:46:31.840 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:47:02.077 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:47:02.081 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:47:32.143 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:47:32.146 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:48:02.297 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:48:02.301 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:48:32.436 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:48:32.439 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:49:02.575 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:49:02.578 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:49:32.714 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:49:32.717 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:50:00.000 INFO:tasks.ceph.mon.a.smithi086.stderr:2023-03-06T20:50:00.000+0000 7fbbadf61700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline; 1 mds daemon damaged 2023-03-06T20:50:02.776 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:50:02.779 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:50:32.892 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:50:32.895 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:51:02.965 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:51:02.968 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:51:33.033 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:51:33.036 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:52:03.202 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:52:03.205 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:52:33.357 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:52:33.360 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:53:03.437 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:53:03.441 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:53:33.594 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:53:33.597 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:54:03.742 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:54:03.745 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:54:33.897 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:54:33.900 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:55:04.044 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:55:04.047 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:55:34.166 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:55:34.169 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:56:04.307 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:56:04.310 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:56:34.443 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:56:34.447 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:57:04.544 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:57:04.547 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:57:34.697 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:57:34.700 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:58:04.857 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:58:04.860 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:58:35.172 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:58:35.175 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:59:05.236 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:59:05.239 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:59:35.374 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T20:59:35.377 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:00:00.000 INFO:tasks.ceph.mon.a.smithi086.stderr:2023-03-06T20:59:59.998+0000 7fbbadf61700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline; 1 mds daemon damaged 2023-03-06T21:00:05.446 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:00:05.449 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:00:35.577 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:00:35.580 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:01:05.757 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:01:05.760 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:01:35.870 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:01:35.873 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:02:06.028 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:02:06.031 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:02:36.156 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:02:36.159 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:03:06.305 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:03:06.308 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:03:36.448 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:03:36.451 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:04:06.586 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:04:06.589 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:04:36.740 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:04:36.743 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:05:06.853 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:05:06.856 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:05:37.009 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:05:37.012 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:06:07.157 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:06:07.159 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:06:37.304 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:06:37.307 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:07:07.433 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:07:07.436 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:07:37.546 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:07:37.549 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:08:07.654 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:08:07.657 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:08:37.794 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:08:37.797 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:09:07.938 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:09:07.941 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:09:38.000 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:09:38.003 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:10:00.000 INFO:tasks.ceph.mon.a.smithi086.stderr:2023-03-06T21:09:59.999+0000 7fbbadf61700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline; 1 mds daemon damaged 2023-03-06T21:10:08.156 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:10:08.159 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:10:38.236 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:10:38.239 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:11:08.390 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:11:08.393 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:11:38.514 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:11:38.517 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:12:08.686 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:12:08.689 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:12:38.874 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:12:38.877 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:13:09.021 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:13:09.024 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:13:39.162 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:13:39.165 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:14:09.302 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:14:09.305 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:14:39.435 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:14:39.438 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:15:09.572 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:15:09.575 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:15:39.729 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:15:39.733 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:16:09.866 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:16:09.869 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:16:40.005 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:16:40.009 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:17:10.269 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:17:10.273 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:17:40.343 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:17:40.347 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:18:10.495 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:18:10.498 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:18:40.632 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:18:40.635 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:19:10.721 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:19:10.724 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:19:40.851 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:19:40.853 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:20:00.000 INFO:tasks.ceph.mon.a.smithi086.stderr:2023-03-06T21:19:59.998+0000 7fbbadf61700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline; 1 mds daemon damaged 2023-03-06T21:20:10.981 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:20:10.984 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:20:41.110 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:20:41.113 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:21:11.166 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:21:11.169 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:21:41.311 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:21:41.314 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:22:11.467 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:22:11.471 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:22:41.595 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:22:41.598 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:23:11.734 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:23:11.736 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:23:41.890 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:23:41.893 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:24:12.044 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:24:12.047 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:24:42.191 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:24:42.194 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:25:12.329 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:25:12.333 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:25:42.461 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:25:42.464 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:26:12.599 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:26:12.602 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:26:42.740 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:26:42.743 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:27:12.820 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:27:12.824 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:27:42.976 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:27:42.980 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:28:13.117 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:28:13.121 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:28:43.244 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:28:43.248 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:29:13.367 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:29:13.370 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:29:43.514 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:29:43.518 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:30:00.000 INFO:tasks.ceph.mon.a.smithi086.stderr:2023-03-06T21:29:59.999+0000 7fbbadf61700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline; 1 mds daemon damaged 2023-03-06T21:30:13.663 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:30:13.666 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:30:43.736 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:30:43.739 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:31:13.848 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:31:13.851 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:31:44.011 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:31:44.014 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:32:14.164 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:32:14.167 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:32:44.277 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:32:44.280 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:33:14.405 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:33:14.407 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:33:44.476 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:33:44.481 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:34:14.624 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:34:14.627 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:34:44.754 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:34:44.756 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:35:14.917 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:35:14.920 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:35:45.038 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:35:45.041 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:36:15.289 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:36:15.292 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:36:45.386 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:36:45.389 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:37:15.527 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:37:15.530 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:37:45.647 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:37:45.650 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:38:15.794 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:38:15.797 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:38:45.883 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:38:45.886 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:39:16.030 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:39:16.033 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:39:46.154 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:39:46.157 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:39:59.999 INFO:tasks.ceph.mon.a.smithi086.stderr:2023-03-06T21:39:59.999+0000 7fbbadf61700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline; 1 mds daemon damaged 2023-03-06T21:40:16.283 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:40:16.286 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:40:46.398 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:40:46.401 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:41:16.537 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:41:16.540 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:41:46.608 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:41:46.612 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:42:16.683 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:42:16.686 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:42:46.745 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:42:46.748 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:43:16.801 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:43:16.804 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:43:46.864 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:43:46.867 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:44:16.977 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:44:16.980 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:44:47.115 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:44:47.118 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:45:17.237 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:45:17.240 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:45:47.383 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:45:47.386 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:46:17.472 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:46:17.475 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:46:47.601 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:46:47.604 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:47:17.672 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:47:17.675 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:47:47.744 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:47:47.747 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:48:17.799 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:48:17.802 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:48:47.864 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:48:47.867 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:49:17.982 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:49:17.986 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:49:48.050 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:49:48.053 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:50:00.000 INFO:tasks.ceph.mon.a.smithi086.stderr:2023-03-06T21:49:59.999+0000 7fbbadf61700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline; 1 mds daemon damaged 2023-03-06T21:50:18.377 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:50:18.379 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:50:48.448 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:50:48.451 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:51:18.509 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:51:18.512 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:51:48.564 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:51:48.569 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:52:18.638 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:52:18.642 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:52:48.784 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:52:48.787 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:53:18.907 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:53:18.910 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:53:49.055 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:53:49.058 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:54:19.116 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:54:19.120 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:54:49.241 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:54:49.244 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:55:19.305 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:55:19.308 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:55:49.364 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:55:49.368 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:56:19.427 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:56:19.430 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:56:49.490 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:56:49.492 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:57:19.578 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:57:19.581 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:57:49.633 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:57:49.636 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:58:19.695 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:58:19.698 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:58:49.759 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:58:49.762 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:59:19.822 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:59:19.826 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:59:49.886 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T21:59:49.889 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:00:00.000 INFO:tasks.ceph.mon.a.smithi086.stderr:2023-03-06T21:59:59.999+0000 7fbbadf61700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline; 1 mds daemon damaged 2023-03-06T22:00:19.962 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:00:19.965 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:00:50.029 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:00:50.032 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:01:20.125 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:01:20.128 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:01:50.280 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:01:50.283 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:02:20.436 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:02:20.439 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:02:50.582 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:02:50.585 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:03:20.697 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:03:20.700 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:03:50.828 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:03:50.831 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:04:20.950 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:04:20.953 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:04:51.093 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:04:51.096 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:05:21.188 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:05:21.191 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:05:51.327 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:05:51.331 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:06:21.482 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:06:21.485 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:06:51.640 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:06:51.643 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:07:21.744 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:07:21.747 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:07:51.876 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:07:51.879 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:08:22.040 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:08:22.044 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:08:52.181 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:08:52.184 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:09:22.252 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:09:22.255 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:09:52.399 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:09:52.403 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:09:59.999 INFO:tasks.ceph.mon.a.smithi086.stderr:2023-03-06T22:09:59.998+0000 7fbbadf61700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline; 1 mds daemon damaged 2023-03-06T22:10:22.530 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:10:22.533 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:10:52.669 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:10:52.673 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:11:22.792 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:11:22.795 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:11:52.932 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:11:52.935 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:12:23.070 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:12:23.073 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:12:53.134 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:12:53.138 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:13:23.265 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:13:23.268 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:13:53.412 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:13:53.415 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:14:23.535 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:14:23.538 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:14:53.673 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:14:53.676 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:15:23.801 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:15:23.804 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:15:53.877 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:15:53.880 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:16:24.008 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:16:24.011 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:16:54.081 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:16:54.084 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:17:24.153 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:17:24.156 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:17:54.300 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:17:54.303 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:18:24.423 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:18:24.426 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:18:54.579 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:18:54.583 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:19:24.706 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:19:24.709 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:19:54.843 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:19:54.846 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:20:00.000 INFO:tasks.ceph.mon.a.smithi086.stderr:2023-03-06T22:19:59.999+0000 7fbbadf61700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline; 1 mds daemon damaged 2023-03-06T22:20:24.923 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:20:24.926 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:20:55.070 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:20:55.074 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:21:25.191 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:21:25.195 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:21:55.321 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:21:55.324 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:22:25.494 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:22:25.497 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:22:55.647 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:22:55.650 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:23:25.798 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:23:25.801 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:23:55.953 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:23:55.956 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:24:26.076 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:24:26.079 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:24:56.224 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:24:56.227 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:25:26.379 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:25:26.383 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:25:56.442 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:25:56.445 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:26:26.580 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:26:26.584 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:26:56.735 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:26:56.738 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:27:26.815 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:27:26.818 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:27:57.108 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:27:57.111 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:28:27.250 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:28:27.253 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:28:57.388 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:28:57.391 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:29:27.467 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:29:27.470 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:29:57.614 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:29:57.617 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:30:00.000 INFO:tasks.ceph.mon.a.smithi086.stderr:2023-03-06T22:29:59.999+0000 7fbbadf61700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline; 1 mds daemon damaged 2023-03-06T22:30:27.753 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:30:27.756 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:30:57.907 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:30:57.910 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:31:27.970 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:31:27.973 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:31:58.032 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:31:58.035 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:32:28.105 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:32:28.108 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:32:58.224 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:32:58.227 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:33:28.354 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:33:28.357 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:33:58.502 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:33:58.505 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:34:28.650 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:34:28.653 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:34:58.787 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:34:58.791 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:35:28.941 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:35:28.944 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:35:59.066 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:35:59.069 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:36:29.123 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:36:29.126 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:36:59.245 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:36:59.248 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:37:29.385 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:37:29.388 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:37:59.531 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:37:59.534 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:38:29.887 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:38:29.891 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:39:00.008 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:39:00.011 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:39:30.121 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:39:30.125 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:40:00.000 INFO:tasks.ceph.mon.a.smithi086.stderr:2023-03-06T22:39:59.999+0000 7fbbadf61700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline; 1 mds daemon damaged 2023-03-06T22:40:00.186 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:40:00.189 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:40:30.268 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:40:30.271 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:41:00.328 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:41:00.331 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:41:30.455 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:41:30.458 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:42:00.603 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:42:00.606 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:42:30.767 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:42:30.770 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:43:00.939 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:43:00.942 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:43:31.019 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:43:31.022 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:44:01.082 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:44:01.085 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:44:31.156 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:44:31.159 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:45:01.221 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:45:01.224 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:45:31.277 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:45:31.280 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:46:01.342 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:46:01.346 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:46:31.414 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:46:31.417 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:47:01.486 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:47:01.489 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:47:31.575 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:47:31.578 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:48:01.647 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:48:01.650 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:48:31.721 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:48:31.724 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:49:01.782 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:49:01.785 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:49:31.854 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:49:31.857 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:50:00.000 INFO:tasks.ceph.mon.a.smithi086.stderr:2023-03-06T22:49:59.999+0000 7fbbadf61700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline; 1 mds daemon damaged 2023-03-06T22:50:02.005 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:50:02.008 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:50:32.088 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:50:32.091 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:51:02.200 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:51:02.202 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:51:32.265 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:51:32.269 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:52:02.328 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:52:02.331 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:52:32.399 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:52:32.402 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:53:02.465 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:53:02.468 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:53:32.595 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:53:32.598 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:54:02.727 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:54:02.730 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:54:32.866 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:54:32.869 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:55:02.988 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:55:02.991 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:55:33.119 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:55:33.122 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:56:03.274 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:56:03.277 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:56:33.337 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:56:33.340 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:57:03.394 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:57:03.397 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:57:33.463 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:57:33.466 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:58:03.522 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:58:03.525 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:58:33.582 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:58:33.585 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:59:03.651 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:59:03.654 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:59:33.706 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T22:59:33.709 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:00:00.000 INFO:tasks.ceph.mon.a.smithi086.stderr:2023-03-06T22:59:59.999+0000 7fbbadf61700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline; 1 mds daemon damaged 2023-03-06T23:00:03.771 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:00:03.774 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:00:33.835 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:00:33.837 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:01:03.890 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:01:03.893 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:01:33.954 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:01:33.957 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:02:04.010 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:02:04.013 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:02:34.082 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:02:34.085 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:03:04.142 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:03:04.145 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:03:34.206 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:03:34.209 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:04:04.262 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:04:04.265 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:04:34.375 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:04:34.378 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:05:04.479 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:05:04.482 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:05:34.609 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:05:34.612 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:06:04.764 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:06:04.767 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:06:34.910 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:06:34.913 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:07:04.985 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:07:04.987 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:07:35.052 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:07:35.055 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:08:05.112 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:08:05.115 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:08:35.186 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:08:35.188 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:09:05.259 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:09:05.261 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:09:35.323 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:09:35.326 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:09:59.999 INFO:tasks.ceph.mon.a.smithi086.stderr:2023-03-06T23:09:59.999+0000 7fbbadf61700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline; 1 mds daemon damaged 2023-03-06T23:10:05.461 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:10:05.464 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:10:35.542 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:10:35.545 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:11:05.647 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:11:05.650 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:11:35.795 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:11:35.798 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:12:05.870 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:12:05.873 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:12:35.933 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:12:35.936 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:13:06.006 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:13:06.009 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:13:36.068 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:13:36.072 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:14:06.132 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:14:06.135 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:14:36.205 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:14:36.208 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:15:06.265 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:15:06.268 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:15:36.329 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:15:36.331 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:16:06.392 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:16:06.395 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:16:36.521 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:16:36.524 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:17:06.626 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:17:06.629 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:17:36.748 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:17:36.751 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:18:06.928 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:18:06.931 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:18:37.067 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:18:37.070 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:19:07.222 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:19:07.225 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:19:37.344 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:19:37.347 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:19:59.999 INFO:tasks.ceph.mon.a.smithi086.stderr:2023-03-06T23:19:59.999+0000 7fbbadf61700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline; 1 mds daemon damaged 2023-03-06T23:20:07.484 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:20:07.487 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:20:37.638 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:20:37.641 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:21:07.792 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:21:07.795 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:21:37.928 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:21:37.932 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:22:08.043 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:22:08.046 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:22:38.190 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:22:38.193 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:23:08.538 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:23:08.541 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:23:38.692 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:23:38.695 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:24:08.758 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:24:08.761 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:24:38.910 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:24:38.913 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:25:09.036 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:25:09.039 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:25:39.151 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:25:39.154 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:26:09.298 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:26:09.301 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:26:39.413 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:26:39.416 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:27:09.595 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:27:09.598 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:27:39.747 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:27:39.750 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:28:09.884 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:28:09.887 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:28:40.097 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:28:40.100 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:29:10.160 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:29:10.163 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:29:40.301 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:29:40.304 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:30:00.000 INFO:tasks.ceph.mon.a.smithi086.stderr:2023-03-06T23:29:59.999+0000 7fbbadf61700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline; 1 mds daemon damaged 2023-03-06T23:30:10.464 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:30:10.467 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:30:40.611 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:30:40.614 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:31:10.751 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:31:10.756 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:31:40.820 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:31:40.823 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:32:10.887 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:32:10.892 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:32:41.017 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:32:41.020 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:33:11.156 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:33:11.159 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:33:41.270 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:33:41.273 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:34:11.418 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:34:11.421 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:34:41.556 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:34:41.559 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:35:11.726 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:35:11.729 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:35:41.872 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:35:41.875 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:36:12.009 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:36:12.012 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:36:42.148 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:36:42.152 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:37:12.305 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:37:12.309 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:37:42.425 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:37:42.427 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:38:12.571 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:38:12.574 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:38:42.700 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:38:42.703 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:39:12.830 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:39:12.833 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:39:42.892 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:39:42.895 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:40:00.000 INFO:tasks.ceph.mon.a.smithi086.stderr:2023-03-06T23:39:59.998+0000 7fbbadf61700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline; 1 mds daemon damaged 2023-03-06T23:40:12.972 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:40:12.977 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:40:43.036 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:40:43.039 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:41:13.099 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:41:13.101 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:41:43.162 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:41:43.165 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:42:13.224 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:42:13.227 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:42:43.288 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:42:43.291 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:43:13.384 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:43:13.387 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:43:43.450 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:43:43.453 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:44:13.505 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:44:13.508 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:44:43.570 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:44:43.573 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:45:13.634 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:45:13.637 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:45:43.723 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:45:43.726 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:46:13.805 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:46:13.808 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:46:43.876 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:46:43.880 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:47:13.956 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:47:13.959 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:47:44.103 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:47:44.106 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:48:14.266 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:48:14.269 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:48:44.358 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:48:44.361 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:49:14.525 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:49:14.527 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:49:44.655 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:49:44.658 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:50:00.000 INFO:tasks.ceph.mon.a.smithi086.stderr:2023-03-06T23:49:59.998+0000 7fbbadf61700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline; 1 mds daemon damaged 2023-03-06T23:50:14.801 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:50:14.805 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:50:44.872 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:50:44.875 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:51:14.936 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:51:14.939 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:51:45.099 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:51:45.102 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:52:15.254 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:52:15.257 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:52:45.376 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:52:45.379 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:53:15.506 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:53:15.509 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:53:45.645 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:53:45.648 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:54:15.716 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:54:15.719 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:54:45.863 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:54:45.866 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:55:15.993 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:55:15.996 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:55:46.057 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:55:46.060 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:56:16.119 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:56:16.122 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:56:46.252 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:56:46.255 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:57:16.410 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:57:16.413 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:57:46.472 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:57:46.475 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:58:16.611 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:58:16.614 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:58:46.686 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:58:46.689 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:59:16.749 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:59:16.753 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:59:46.812 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:59:46.815 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-06T23:59:59.999 INFO:tasks.ceph.mon.a.smithi086.stderr:2023-03-06T23:59:59.999+0000 7fbbadf61700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline; 1 mds daemon damaged 2023-03-07T00:00:16.883 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:00:16.887 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:00:46.970 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:00:46.973 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:01:17.088 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:01:17.091 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:01:47.212 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:01:47.216 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:02:17.334 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:02:17.337 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:02:47.481 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:02:47.487 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:03:17.553 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:03:17.558 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:03:47.619 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:03:47.622 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:04:17.756 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:04:17.760 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:04:47.896 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:04:47.899 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:05:18.035 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:05:18.038 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:05:48.141 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:05:48.144 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:06:18.264 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:06:18.267 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:06:48.411 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:06:48.414 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:07:18.683 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:07:18.687 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:07:48.806 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:07:48.809 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:08:18.895 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:08:18.899 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:08:49.017 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:08:49.021 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:09:19.157 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:09:19.160 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:09:49.313 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:09:49.316 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:10:00.000 INFO:tasks.ceph.mon.a.smithi086.stderr:2023-03-07T00:09:59.999+0000 7fbbadf61700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline; 1 mds daemon damaged 2023-03-07T00:10:19.376 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:10:19.379 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:10:49.500 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:10:49.503 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:11:19.597 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:11:19.600 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:11:49.703 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:11:49.706 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:12:19.773 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:12:19.776 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:12:49.830 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:12:49.833 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:13:19.900 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:13:19.904 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:13:49.965 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:13:50.021 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:14:20.078 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:14:20.081 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:14:50.163 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:14:50.166 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:15:20.301 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:15:20.304 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:15:50.407 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:15:50.410 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:16:20.466 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:16:20.469 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:16:50.594 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:16:50.597 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:17:20.660 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:17:20.663 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:17:50.789 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:17:50.792 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:18:20.861 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:18:20.864 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:18:50.975 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:18:50.978 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:19:21.048 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:19:21.051 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:19:51.220 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:19:51.223 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:20:00.000 INFO:tasks.ceph.mon.a.smithi086.stderr:2023-03-07T00:19:59.999+0000 7fbbadf61700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline; 1 mds daemon damaged 2023-03-07T00:20:21.281 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:20:21.284 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:20:51.424 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:20:51.427 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:21:21.483 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:21:21.486 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:21:51.635 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:21:51.638 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:22:21.774 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:22:21.777 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:22:51.930 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:22:51.933 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:23:22.095 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:23:22.098 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:23:52.217 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:23:52.220 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:24:22.338 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:24:22.342 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:24:52.489 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:24:52.492 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:25:22.634 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:25:22.638 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:25:52.754 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:25:52.756 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:26:22.917 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:26:22.920 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:26:53.072 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:26:53.075 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:27:23.197 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:27:23.200 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:27:53.356 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:27:53.359 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:28:23.496 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:28:23.499 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:28:53.635 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:28:53.638 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:29:23.789 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:29:23.792 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:29:53.919 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:29:53.922 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:30:00.001 INFO:tasks.ceph.mon.a.smithi086.stderr:2023-03-07T00:29:59.999+0000 7fbbadf61700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline; 1 mds daemon damaged 2023-03-07T00:30:24.049 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:30:24.053 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:30:54.180 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:30:54.183 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:31:24.318 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:31:24.321 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:31:54.457 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:31:54.460 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:32:24.603 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:32:24.606 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:32:54.742 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:32:54.745 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:33:24.877 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:33:24.880 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:33:55.152 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:33:55.155 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:34:25.308 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:34:25.311 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:34:55.462 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:34:55.465 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:35:25.608 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:35:25.611 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:35:55.663 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:35:55.666 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:36:25.802 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:36:25.805 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:36:55.882 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:36:55.885 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:37:25.978 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:37:25.981 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:37:56.049 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:37:56.053 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:38:26.126 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:38:26.129 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:38:56.278 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:38:56.281 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:39:26.415 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:39:26.419 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:39:56.554 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:39:56.557 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:40:00.000 INFO:tasks.ceph.mon.a.smithi086.stderr:2023-03-07T00:39:59.999+0000 7fbbadf61700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline; 1 mds daemon damaged 2023-03-07T00:40:26.625 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:40:26.628 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:40:56.746 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:40:56.749 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:41:26.902 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:41:26.905 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:41:56.958 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:41:56.961 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:42:27.095 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:42:27.099 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:42:57.236 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:42:57.239 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:43:27.391 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:43:27.394 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:43:57.706 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:43:57.709 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:44:27.766 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:44:27.769 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:44:57.888 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:44:57.891 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:45:27.968 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:45:27.971 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:45:58.106 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:45:58.109 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:46:28.186 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:46:28.189 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:46:58.298 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:46:58.301 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:47:28.446 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:47:28.449 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:47:58.586 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:47:58.589 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:48:28.748 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:48:28.751 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:48:58.903 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:48:58.905 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:49:28.999 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:49:29.003 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:49:59.121 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:49:59.124 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:50:00.000 INFO:tasks.ceph.mon.a.smithi086.stderr:2023-03-07T00:49:59.999+0000 7fbbadf61700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline; 1 mds daemon damaged 2023-03-07T00:50:29.251 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:50:29.254 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:50:59.398 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:50:59.401 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:51:29.545 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:51:29.548 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:51:59.700 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:51:59.703 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:52:29.830 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:52:29.833 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:52:59.969 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:52:59.972 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:53:30.132 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:53:30.135 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:54:00.203 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:54:00.206 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:54:30.267 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:54:30.270 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:55:00.406 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:55:00.409 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:55:30.545 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:55:30.548 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:56:00.682 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:56:00.685 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:56:30.830 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:56:30.833 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:57:00.951 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:57:00.953 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:57:31.072 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:57:31.076 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:58:01.211 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:58:01.214 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:58:31.342 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:58:31.345 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:59:01.489 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:59:01.492 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:59:31.618 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T00:59:31.622 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:00:00.000 INFO:tasks.ceph.mon.a.smithi086.stderr:2023-03-07T00:59:59.998+0000 7fbbadf61700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline; 1 mds daemon damaged 2023-03-07T01:00:01.732 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:00:01.734 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:00:31.870 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:00:31.873 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:01:01.985 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:01:01.988 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:01:32.130 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:01:32.133 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:02:02.268 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:02:02.271 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:02:32.406 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:02:32.409 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:03:02.479 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:03:02.482 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:03:32.610 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:03:32.613 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:04:02.708 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:04:02.711 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:04:32.838 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:04:32.841 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:05:02.914 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:05:02.917 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:05:32.978 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:05:32.981 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:06:03.041 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:06:03.044 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:06:33.104 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:06:33.107 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:07:03.168 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:07:03.170 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:07:33.232 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:07:33.235 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:08:03.296 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:08:03.299 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:08:33.386 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:08:33.389 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:09:03.458 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:09:03.461 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:09:33.514 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:09:33.517 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:10:00.000 INFO:tasks.ceph.mon.a.smithi086.stderr:2023-03-07T01:09:59.999+0000 7fbbadf61700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline; 1 mds daemon damaged 2023-03-07T01:10:03.576 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:10:03.579 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:10:33.664 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:10:33.667 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:11:03.723 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:11:03.727 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:11:33.796 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:11:33.799 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:12:03.862 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:12:03.865 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:12:33.924 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:12:33.927 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:13:04.022 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:13:04.026 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:13:34.170 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:13:34.174 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:14:04.276 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:14:04.279 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:14:34.432 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:14:34.435 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:15:04.562 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:15:04.565 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:15:34.697 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:15:34.706 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:16:04.771 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:16:04.774 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:16:35.130 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:16:35.134 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:17:05.271 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:17:05.274 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:17:35.353 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:17:35.356 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:18:05.425 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:18:05.428 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:18:35.579 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:18:35.582 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:19:05.693 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:19:05.697 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:19:35.815 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:19:35.818 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:19:59.999 INFO:tasks.ceph.mon.a.smithi086.stderr:2023-03-07T01:19:59.998+0000 7fbbadf61700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline; 1 mds daemon damaged 2023-03-07T01:20:05.945 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:20:05.949 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:20:36.116 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:20:36.119 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:21:06.238 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:21:06.241 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:21:36.376 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:21:36.379 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:22:06.540 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:22:06.543 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:22:36.662 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:22:36.665 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:23:06.808 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:23:06.812 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:23:36.972 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:23:36.975 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:24:07.110 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:24:07.113 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:24:37.257 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:24:37.261 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:25:07.332 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:25:07.335 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:25:37.434 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:25:37.441 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:26:07.589 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:26:07.592 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:26:37.711 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:26:37.713 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:27:07.849 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:27:07.852 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:27:37.996 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:27:37.999 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:28:08.126 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:28:08.129 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:28:38.256 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:28:38.260 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:29:08.319 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:29:08.322 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:29:38.467 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:29:38.474 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:30:00.000 INFO:tasks.ceph.mon.a.smithi086.stderr:2023-03-07T01:29:59.999+0000 7fbbadf61700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline; 1 mds daemon damaged 2023-03-07T01:30:08.631 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:30:08.635 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:30:38.744 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:30:38.747 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:31:08.885 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:31:08.888 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:31:39.021 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:31:39.024 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:32:09.182 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:32:09.185 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:32:39.319 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:32:39.321 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:33:09.450 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:33:09.453 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:33:39.614 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:33:39.617 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:34:09.758 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:34:09.761 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:34:39.855 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:34:39.858 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:35:09.948 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:35:09.951 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:35:40.101 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:35:40.104 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:36:10.258 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:36:10.262 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:36:40.381 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:36:40.384 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:37:10.604 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:37:10.607 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:37:40.667 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:37:40.671 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:38:10.810 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:38:10.813 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:38:40.973 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:38:40.976 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:39:11.095 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:39:11.098 DEBUG:teuthology.orchestra.run.smithi202:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-07T01:39:25.862 DEBUG:teuthology.exit:Got signal 15; running 1 handler... 2023-03-07T01:39:25.863 DEBUG:teuthology.task.console_log:Killing console logger for smithi086 2023-03-07T01:39:25.864 DEBUG:teuthology.task.console_log:Killing console logger for smithi202 2023-03-07T01:39:25.864 DEBUG:teuthology.exit:Finished running handlers